Database query and data mining in intelligent distributed communication networks

ABSTRACT

A system includes a processor and a memory device communicatively coupled to the processor. The system also includes a database communicatively coupled to the processor. The database is configured to store a first plurality of prediction sets. Each prediction set is associated with a respective individual within a first population. Each prediction set comprises a plurality of prediction results, and each prediction result corresponds to a selected one of a plurality of features. The processor is configured to receive a request for a distribution value associated with a selected feature and one or more parameters. The distribution value indicate how often the selected feature appears in a second population of individuals, the second population being defined by the one or more parameters.

PRIORITY AND RELATED APPLICATION

This application is a continuation in part of U.S. patent applicationSer. No. 15/594,526, filed on May 12, 2017, which is a continuation ofU.S. application Ser. No. 15/347,777, filed on Nov. 9, 2016, which is acontinuation of U.S. Ser. No. 14/968,596, filed on Dec. 14, 2015, Issuedas U.S. Pat. No. 9,524,469 on Dec. 20, 2016 all of which are herebyincorporated by reference herein in its entirety as if set forth herein.

TECHNICAL FIELD

This specification relates generally to intelligent telecommunicationnetworks, and more particularly to datamining using distributedintelligent networks.

BACKGROUND

Efficient database query mechanisms is an important need for distributedtelecommunication networks. As the amount of data generated and held bythe distributed networks increase, it becomes more necessary toeffectively manage and query databases adapted to distributed networks.

Social media has become a big part of the Internet. Many social mediacompanies exist that allow users to post and share information to theirnetwork of friends. Companies and brands constantly search foropportunities to use such data to increase brand value. Monetizing onthat data however, can be troublesome and burdensome because of the vastamount of data that need to be sifted through. One challenge faced bybrands is that many attributes of an audience (such as gender,ethnicity, age, etc.) that is talking about a brand or topic on socialmedia may be hidden by the author because of privacy concerns.

For marketers and advertisers, analyzing demographic informationconcerning a target audience can provide valuable information. Knowledgeof the demographics of a crowd of people at a venue such as a stadiumcan be very helpful in selecting appropriate advertisements to displayto the crowd. Knowledge of the demographics of people reacting to amarketing campaign on social media can be helpful in market research. Inother fields as well, obtaining accurate insight into individuals'behavior, of economic activity, etc., can provide useful information.Many companies and organizations frequently generate predictions forsuch unknown variables based on one or more known variables. However, inmany instances obtaining accurate predictions for a desired item ofinformation can be difficult. In many existing systems, simplisticassumptions are made to generate a prediction, often producinginaccurate results.

SUMMARY

In general, one aspect of the subject matter described in thisspecification may be embodied in methods that include the actions offiltering social media data for content resources that match one or moresearch terms; providing the content resources to a user interface;receiving a selection of one or more of the content resources; receivinga selection to create a new visual based on data received; creating avisualization instance; and providing the visualization instance to bedisplayed on the user interface.

Other embodiments of these aspects include corresponding systems,apparatus, and computer-readable medium storing software comprisinginstructions executable by one or more computers, which cause thecomputers to perform the actions of the methods.

Another aspect of the subject matter described in this specification maybe embodied in methods that include the actions of receivingvisualization settings at a server visualization loader; identifyingvisualization data sources; creating a visualization controller from thevisualization data sources, visualization structure and visualizationsettings; providing to a visualization instance manager thevisualization controller and generated visualization style; and creatingwith the visualization instance manager a visualization instance basedon the visualization controller and generated visualization style.

Other embodiments of these aspects include corresponding systems,apparatus, and computer-readable medium storing software comprisinginstructions executable by one or more computers, which cause thecomputers to perform the actions of the methods.

Another aspect of the subject matter described in this specification maybe embodied in methods that include the actions of selecting allelements on a webpage, by a client loader that have a first attributeand make a request to a server loader for a visualization manager,including the value of all of the attributes. For each of the visualidentifications sent with the request, look up the html, less, js,settings, and data sources by a server loader; running, at the serverloader, each of a number of styles through a style generator with theassociated settings; building by the server loader, the client instancemanager and injecting the generated styles with the controllers;appending the styles for each of the loaded instances into a head of thewebpage by the client instance manager; wait for the page to finishloading its own elements at the client instance manager; expose an APIfor interacting with instances at the client instance manger; andconstruct each of the Visual Instances using the controller at theclient instance manager.

Other embodiments of these aspects include corresponding systems,apparatus, and computer-readable medium storing software comprisinginstructions executable by one or more computers, which cause thecomputers to perform the actions of the methods.

Another aspect of the subject matter described in this specification maybe embodied in methods that include the actions of filtering socialmedia data for content resources; providing the content resources to auser interface; receiving a selection to create a new visual based onthe content resources; creating a visualization instance based onsettings associated with the new visual; and providing the visualizationinstance to be displayed on the user interface.

Other embodiments of these aspects include corresponding systems,apparatus, and computer-readable medium storing software comprisinginstructions executable by one or more computers, which cause thecomputers to perform the actions of the methods.

Another aspect of the subject matter described in this specification maybe embodied in methods that include the actions of identifying socialmedia data for content resources based on preferences; receiving aselection to create a new visual for the content resources; identifyingadvertisements associated with the content resources; creating avisualization instance for the advertisements or the content resourcesbased on settings associated with the new visual; providing thevisualization instance to be displayed on the user interface.

In accordance with an embodiment, a system is provided. The systemincludes a feed module adapted to generate a feed comprising a pluralityof items of social media content. The system also includes a templatestore adapted to store a plurality of templates, wherein each templateincludes a respective data source generator and a settings module. Thesystem also includes a visual generation manager adapted to provide afirst user interface displaying a plurality of icons each representing arespective one of the plurality of templates, receive from the user aselection of a template from the plurality of templates, provide asecond user interface prompting the user to specify one or moresettings, receive from the user settings information specifying the oneor more settings, generate a visual instance comprising the settingsinformation and a data source, wherein the data source comprises codeadapted to render at least a portion of a visual based on the settingsinformation and on one or more items of social media content selectedfrom the feed, and store the visual instance in a memory. The systemfurther includes a visual instance loader adapted to cause the visualinstance to render a visual based on the settings information and on oneor more items of social media content selected from the feed.

In one embodiment, the feed module obtains items of social media contentincluding one of a message, a comment, a photo, and a video posted to anonline social networking service.

In another embodiment, the plurality of templates include a firsttemplate for generating a first visual instance adapted to generate afirst visual that includes a line graph of social media activity, asecond template for generating a second visual instance adapted togenerate a second visual that includes a heat map of social mediaactivity, and a third template for generating a third visual instanceadapted to generate a third visual that includes a sentiment analysis ofsocial media activity.

In another embodiment, the system also includes at least one processoradapted to add to an item of social media content a tag defining acharacteristic of the item of social media content.

In another embodiment, the at least one processor is further adapted toidentify an individual attending a live event taking place in a venue,select an item of social media content associated with the individual,the item of social media content having a first tag, select anadvertisement image having a second tag that matches the first tag,generate a visual instance adapted to display the selected item ofsocial media content and the advertisement image simultaneously, andcause the visual instance to display the selected item of social mediacontent and the advertisement image simultaneously on a display devicelocated in the venue.

In another embodiment, the venue is one of a stadium, a conferencecenter, a retail store, and a commercial mall.

In accordance with another embodiment, a method is provided. A visualtemplate is selected from a plurality of stored visual templates,wherein the visual template includes a data source generator and asettings module, a user interface indicating one or more settings thatmust be specified to create the visual instance is provided, andsettings information specifying the one or more settings are receivedfrom a user. A visual instance is generated based on the visual templateand the settings information, the visual instance comprising thesettings information and a data source adapted to render a visual basedon the settings information and on one or more items of social mediacontent selected from a feed. The visual instance is stored in a memory.The visual instance is caused to display the visual.

In accordance with an embodiment, an individual having a plurality offirst features and a second characteristic is identified. A plurality ofsecond features associated with a second characteristic are determined.For each first feature among the plurality of first features, arespective probability distribution indicating, for each respectivesecond feature, a probability that a person having the respective secondfeature has the first feature, is determined, thereby generating aplurality of probability distributions. A probabilistic classifier isused to generate a merged probability based on the plurality ofprobability distributions. A Monte Carlo method is used to generate aprediction set based on the merged probability distribution, theprediction set including a plurality of prediction values for the secondcharacteristic of the individual, each respective prediction value beingassociated with one of the plurality of second features. The predictionset is stored in a memory.

In one embodiment, the probabilistic classifier includes a Naive-Bayesmethod.

In another embodiment, a scale comprising a plurality of numericalranges is defined, based on the merged probability distribution. Each ofthe plurality of numerical ranges of the scale is associated with arespective second feature, based on the merged probability distribution.

In another embodiment, a plurality of random numbers is generated, and aprediction set is generated based on the plurality of random numbers.

In another embodiment, the following steps are performed for each randomnumber among the plurality of random numbers: a particular numericalrange associated with the respective random number is identified, fromamong the plurality of numerical ranges, a second feature associatedwith the particular numerical range is identified, and the respectiverandom number is associated with the identified second feature.

In another embodiment, a plurality of individuals attending a live eventat a venue are identified, and a plurality of prediction sets associatedwith the plurality of individuals are generated.

In another embodiment, an advertisement image is selected based on theplurality of prediction sets, and the advertisement image is displayedon a display device associated with the plurality of individuals.

In another embodiment, the venue is one of a stadium, a conferencecenter, a public space, and a commercial mall.

In another embodiment, a second probability distribution indicating, foreach respective second feature, a probability that a person in apopulation has the second feature, is determined. A probabilisticclassifier is used to generate a merged probability distribution basedon the plurality of probability distributions and the second probabilitydistribution.

In accordance with another embodiment, a system includes at least onememory adapted to store data defining features of one or moreindividuals, and at least one processor. The at least one processor isadapted to identify an individual having a plurality of first featuresand a second characteristic and determine a plurality of second featuresassociated with a second characteristic. The at least one processor isalso adapted to perform the following step for each first feature amongthe plurality of first features: determine a respective probabilitydistribution indicating, for each respective second feature, aprobability that a person having the respective second feature has thefirst feature, thereby generating a plurality of probabilitydistributions. The at least one processor is further adapted to use aprobabilistic classifier to combine the plurality of probabilitydistributions, thereby generating a merged probability distribution, usea Monte Carlo method to generate a prediction set based on the mergedprobability distribution, the prediction set including a plurality ofprediction values for the second characteristic of the individual, eachrespective prediction value being associated with one of the pluralityof second features, and store the prediction set in the at least onememory.

In accordance with another embodiment, a system for generatingpredictions of demographic information. The system includes a processor,a memory communicatively coupled to the processor, an individual featurestore, communicatively coupled to the processor, configured to store aplurality of individual data objects, an individual data objectcomprising data indicating one or more features of an individual, and aprediction manager component communicatively coupled to the individualfeature store, the prediction manager component configured to receiveinformation related to a particular individual, and create and store inthe individual data store a prediction set comprising a plurality oftest results.

In accordance with another embodiment, a system includes a plurality ofdisplay devices located at respective locations in a venue and at leastone memory adapted to store data defining features of one or moreindividuals. The system also includes at least one processor adapted toidentify a plurality of individuals at a venue, the plurality ofindividuals associated with a particular location in the venue, obtain aplurality of prediction sets associated with the plurality ofindividuals, select an advertisement image based on the plurality ofprediction sets, and display the selected advertisement image on aparticular display device associated with the particular location.

In one embodiment, the at least one processor is further adapted to adda first tag to the advertisement image, obtain an item of social mediacontent associated with at least one of the individuals among theplurality of individuals, add a second tag to the item of social mediacontent, and display the item of social media content and theadvertisement image on the particular display device, if the first tagmatches the second tag.

In accordance with another embodiment, a system includes a processor, amemory communicatively coupled to the processor, and a prediction setstore communicatively coupled to the processor, configured to store aplurality of prediction set objects, each prediction set objectcomprising a prediction set that includes a plurality of test results.The system also includes a prediction management module, communicativelycoupled to the memory, configured to generate a plurality of predictionsets, each prediction set being associated with a respective individualwithin a population of individuals, each prediction set comprising arespective plurality of prediction results, each prediction resultcorresponding to a selected one of a plurality of features, store theplurality of prediction sets in the prediction set store, at a firsttime, retrieve the plurality of prediction sets from the prediction setstore, at a second time, define a plurality of prediction result groups,each prediction result group comprising a plurality of correspondingprediction results selected from the plurality of prediction sets, eachprediction result group comprising one prediction result selected fromeach of the plurality of prediction sets, generate a plurality ofdistribution values associated with a selected feature by determining,for each respective prediction result group, a respective distributionvalue for the selected feature based on the respective plurality ofcorresponding prediction results in the respective prediction resultgroup, and determine an average distribution value based on theplurality of distribution values.

In one embodiment, each respective distribution value represents apercentage of the respective prediction results in the correspondingprediction result group that correspond to the selected feature.

In another embodiment, the average distribution value represents apercentage of the individuals in the population that have the selectedfeature.

In another embodiment, the plurality of features include one of male andfemale, a several discrete age ranges, several discrete income ranges,and several discrete ethnicities.

In another embodiment, the prediction management module is furtherconfigured to receive, from a user, a request for a distribution valueassociated with the selected feature, the distribution value indicatinghow often the selected feature appears in the population, and providethe average distribution value to the user.

In another embodiment, the prediction management module is furtherconfigured to provide to the user access to a page that includes agraphical representation of the average distribution.

In another embodiment, the prediction management module is furtherconfigured to obtain at least one of the plurality of prediction sets byperforming the following steps: determine a plurality of probabilitydistributions associated with a particular individual, use aprobabilistic classifier to generate a merged probability distributionbased on the plurality of probability distributions, and use a MonteCarlo method to generate a prediction set associated with the particularindividual based on the merged probability distribution.

In another embodiment, the prediction management module is furtherconfigured to retrieve the plurality of prediction sets from a storage.

In another embodiment, a method is provided. The method includesobtaining a plurality of prediction sets, each prediction set beingassociated with a respective individual within a population ofindividuals, each prediction set comprising a plurality of predictionresults, each prediction result corresponding to a selected one of aplurality of features, defining a plurality of prediction result groups,each prediction result group comprising a plurality of correspondingprediction results selected from the plurality of prediction sets, eachprediction result group comprising one prediction result selected fromeach of the plurality of prediction sets, generating a plurality ofdistribution values associated with a selected feature by determining,for each respective prediction result group, a respective distributionvalue for the selected feature based on the respective plurality ofcorresponding prediction results in the respective prediction resultgroup, and determining an average distribution value based on theplurality of distribution values.

In one embodiment, each respective distribution value represents apercentage of the respective prediction results in the correspondingprediction result group that correspond to the selected feature.

In another embodiment, the average distribution value represents apercentage of the individuals in the population that have the selectedfeature.

In accordance with another embodiment, a system includes a memoryadapted to store one or more prediction sets. The system also includesat least one processor adapted to obtain a plurality of prediction sets,each prediction set being associated with a respective individual withina population of individuals, each prediction set comprising a respectiveplurality of prediction results, each prediction result corresponding toa selected one of a plurality of features. The at least one processor isalso adapted to define a plurality of prediction result groups, eachprediction result group comprising a plurality of correspondingprediction results selected from the plurality of prediction sets, eachprediction result group comprising one prediction result selected fromeach of the plurality of prediction sets, generate a plurality ofdistribution values associated with a selected feature by determining,for each respective prediction result group, a respective distributionvalue for the selected feature based on the respective plurality ofcorresponding prediction results in the respective prediction resultgroup, and determine an average distribution value based on theplurality of distribution values.

Other embodiments of these aspects include corresponding systems,apparatus, and computer-readable medium storing software comprisinginstructions executable by one or more computers, which cause thecomputers to perform the actions of the methods.

Further embodiments, features, and advantages, as well as the structureand operation of the various embodiments are described in detail belowwith reference to accompanying drawings.

BRIEF DESCRIPTION OF THE FIGURES

Embodiments are described with reference to the accompanying drawings.In the drawings, like reference numbers may indicate identical orfunctionally similar elements.

FIG. 1 illustrates a system for an engagement platform.

FIG. 2 illustrates a system for an engagement platform.

FIG. 3 is a screenshot of the engagement platform.

FIG. 4 is a screenshot of the engagement platform.

FIG. 5 is a screenshot of the engagement platform.

FIG. 6 is a screenshot of the engagement platform.

FIG. 7 is a screenshot of the engagement platform.

FIG. 8 is a screenshot of the engagement platform.

FIG. 9 is a screenshot of the engagement platform.

FIG. 10 is a screenshot of the engagement platform.

FIG. 11 is a screenshot of the engagement platform.

FIG. 12 is a screenshot of the engagement platform.

FIG. 13 is a sequence diagram in accordance with an embodiment.

FIG. 14 illustrates a flowchart of an example process.

FIG. 15 is a diagram of an example computer device used to implement thesystem.

FIG. 16 shows a social content and advertisement synchronization systemin accordance with an embodiment.

FIG. 17 shows a venue for a live event in accordance with an embodiment.

FIG. 18 is a flowchart of a method of displaying curated social mediacontent on a display device during a live event in accordance with anembodiment.

FIG. 19 shows a photo of fans cheering during a game displayed on adisplay device.

FIG. 20 shows a photo of fans and an advertisement image displayed on adisplay device in accordance with an embodiment.

FIG. 21 shows a visual management system in accordance with anembodiment.

FIG. 22 shows components of a template in accordance with an embodiment.

FIG. 23A shows a web page displaying a plurality of templates inaccordance with an embodiment.

FIG. 23B shows a web page that prompt a user to specify a setting inaccordance with an embodiment.

FIG. 23C shows a web page that prompt a user to specify a setting inaccordance with an embodiment.

FIG. 23D shows a web page that prompt a user to specify a setting inaccordance with an embodiment.

FIG. 23E shows a web page that prompt a user to specify a setting inaccordance with an embodiment.

FIG. 24 shows components of a visual instance in accordance with anembodiment.

FIG. 25 shows a page which displays a feed in accordance with anembodiment.

FIG. 26A shows a web page on which a visual instance is displayed inaccordance with an embodiment.

FIG. 26B shows a web page on which a visual instance is displayed inaccordance with an embodiment.

FIG. 27 shows a page displaying a visual showing positive and negativesentiments in accordance with an embodiment.

FIG. 28 shows a page displaying a visual showing a heat map of socialmedia activity in accordance with an embodiment.

FIG. 29 is a flowchart of a method of creating a visual instance inaccordance with an embodiment.

FIG. 30A shows a template object store in accordance with an embodiment.

FIG. 30B shows a visual instance object store in accordance with anembodiment.

FIG. 31 shows a visual displayed on a touch screen device in accordancewith an embodiment.

FIG. 32 is a flowchart of a method of displaying social media contentand advertisements in accordance with an embodiment.

FIG. 33 shows a demographic data gathering and advertisement deliverysystem in accordance with an embodiment.

FIG. 34 shows components of an analysis module in accordance with anembodiment.

FIG. 35A is a flowchart of a method of generating a plurality ofprediction sets for an individual in accordance with an embodiment.

FIG. 35B is a flowchart of a method of generating a plurality ofprediction sets for an individual in accordance with another embodiment.

FIG. 36A shows a probability distribution in accordance with anembodiment.

FIG. 36B shows a probability distribution in accordance with anembodiment.

FIG. 36C shows a probability distribution in accordance with anembodiment.

FIG. 36D shows a probability distribution in accordance with anembodiment.

FIG. 37 shows a merged probability distribution in accordance with anembodiment.

FIG. 38 shows an illustrative example of a prediction set in accordancewith an embodiment.

FIG. 39 is a flowchart of a method of generating a plurality ofprediction sets for a plurality of individuals in accordance with anembodiment.

FIG. 40 is a flowchart of a method of selecting an advertisement imagebased on a plurality of prediction sets in accordance with anembodiment.

FIG. 41A shows a venue for a live event in accordance with anembodiment.

FIG. 41B shows a system in accordance with another embodiment.

FIG. 42A is a flowchart of a method of generating distributioninformation based on a plurality of prediction sets in accordance withan embodiment.

FIG. 42B is a flowchart of a method of generating distributioninformation based on a plurality of prediction sets in accordance withan embodiment.

FIG. 43A illustrates a plurality of prediction sets in accordance withan embodiment.

FIG. 43B illustrates a plurality of prediction result groups definedbased on the plurality of prediction sets of FIG. 43A.

FIG. 44 shows a web page displayed on a display device in accordancewith an embodiment.

FIG. 45A shows a conference center with four conference rooms.

FIG. 45B is a flowchart of a method of selecting and displaying anadvertisement image based on a plurality of prediction sets inaccordance with an embodiment.

FIG. 46 is a flowchart of a method of providing data in response to arequest from a user in accordance with an embodiment.

DETAILED DESCRIPTION

A system will be described that allows users to create visualizations.

FIG. 1 illustrates an example of a networked system 100 of devices,perhaps mobile devices such as mobile phones, tablets or computers. Thedevices may be networked over network 102. Network 102 may be anyintelligent network or combination of intelligent networks that cancarry data communications. Such a network 102 may include, but is notlimited to, a local area network, metropolitan area network, and/or widearea network such as the Internet. Network 102 can support protocols andtechnology including, but not limited to, World Wide Web (or simply the“Web”), protocols such as a Hypertext Transfer Protocol (“HTTP”) andHTTPS protocols, and/or services. Intermediate web servers, gateways, orother servers may be provided between components of the system shown inFIG. 1 , depending upon a particular application or environment.

A user may operate a user interface on user device 110 to createengagement content on server 120. User device 110 may be coupled toserver 120 over network 102. Server 120 includes curation system 104,which may be used to provide information to user device 110. Engagementapplication 108 may be implemented on or implemented with one or morecomputing devices, such as user device 110.

In one embodiment, the functionality of engagement application 108and/or curation system 104 may be provided through a browser 106 oncomputing devices, such as user device 110. Curation system 104 onserver 120 may host the service and serve it to device 110 and any othercomputing devices. Any combination of implementations may provide,through a browser, the functionality represented by the exampleimplementations of systems 108 and 110 shown in FIG. 1 and in thescreenshots and flowchart of FIGS. 3-14 . Any stages shown in flowchartof FIG. 14 that involve displaying content may be considered to providethe content for display in a browser.

Browser 106 may be any commonly used browser, including anymulti-threaded or multi-process browser. In one embodiment, thefunctionality of engagement application 108 can be provided throughbrowser 106. The functionality of any of the components or flowchartsshown in the figures may be provided through the browser executed ondevice 110, server 120 or any other computing device. The web pages orapplication provided through the browser may be served from server 120,device 110, or any other computing device. Different windows or viewsmay be shown through browser 106.

In one embodiment, users can monitor social media data and createvisualizations around the data. A visualization is a packaged set ofresources that can be loaded into a web page. Each visualizationcontains definitions for structure, style, and functionality. Thevisualizations are data driven and can implement multiple data sources.They also expose configurable settings. Structure: The structure of thevisualization is defined using HTML. Rather than defining an entirepage, the HTML only defines a fragment of HTML that will be injectedinto an existing page. Style: The style of the components is definedusing the Less language. The Less is then compiled to CSS against thevisualization settings and a built-in library of Less Mixins and LessVariables. Functionality: The functionality of the visualization isdefined using JavaScript and is used by the client's browser toinstantiate the visualization. Settings: Settings for the visualizationcan be broken into two categories: style and functionality. Stylesettings are converted into Less variables and injected into styledefined for the visualization.

Functionality settings are converted into a JavaScript object andinjected into the JavaScript controller. All settings not otherwisedesignated are injected into the JavaScript controller as a JavaScriptobject. These settings are used to allow the users to configure thefunctionality of the visualization. Data Sources: Data sources definewhat data the visualization will consume. The data source definitionsare injected into the JavaScript controller, optionally along with theactual data. If the data is not included in the initial load, it can beloaded asynchronously. Loader: Part of embedding a visualization into apage is including a small client-side loading script. The client-sideloading script finds all embeds on the page and sends one batch loadrequest to the server. The server then dynamically builds a script tosend back to the client. The script contains the initializationfunctions for each of the visualizations. Once the script is sent backto the client, it initializes all of the visualizations and tracks themthrough the lifetime of the page. It also defines an API for interactingwith the visualizations.

The JavaScript controller can reside on the server visualization loader,which can all reside on the server 120 and/or the curation system 104.In one embodiment, the visualizations can be for the advertisementsassociated with the social media data as described further below. Thedata sources can reside on server 120. In one embodiment, the servervisualization loader is the server 120. The visualization instancemanager can reside on user device 110. In one embodiment, thevisualization instance manager is the engagement application 108. Inanother embodiment, the visualization instance manager is on the userdevice 110 along with the engagement application 108.

In an example, the server 120 includes a database 112. The database 112may store the data to be accessed by any of the server 120 and the userdevice 110. The database 112 may store data collected from the network102. In an example, the database 112 may also store data generated byany of the server 120 and the user device 110. In an example, thedatabase 112 may store and allow access to the data in any of arelational, a self-referential, operational, distributed, columnoriented, object, key-value, navigational, and active formats.

In one embodiment, as shown in FIGS. 14 a-14 m , from a dashboard a usercan select to create a new visual. They then select a category and aspecific template. The user gives the visual a title and selects a feedto use as a default data source. The feed is a social media conversationas described in further detail below. The user can edit the settingsrelated to the visualization. The visualization is then embedded into awebpage.

The edit page a user can use to edit the settings provides color pickercontrols, calendar picker controls, file upload controls, and othercustom controls as well as validation on input and a much better userexperience. It is not possible to enter invalid configuration throughthis page but it is also more restrictive to the values that can beentered. Additional settings can be added to instances latter by the enduser through the advanced edit screen but those additional setting wouldnot be available to edit through the normal edit page.

FIG. 2 is a block diagram 200 of the functionality of engagementapplication 108 and the curation system 104. The curation system 104 incombination with the engagement application 108 collects social content202 by providing its users with the ability to retrieve content fromsocial media platforms such as Twitter (an online social networkingservice that enables users to send and read short 140-character messagescalled “tweets”), Facebook (an online social networking service thatallows users to create a profile page, post information, comments,photos and videos, exchange messages, etc.) and Instagram (an onlinesocial networking and online photo-sharing and video-sharing service) aswell as others. Content is collected via Application ProgrammingInterface (API) 204 from Twitter Stream API, Facebook Social Graph API,Instagram API, and other third party APIs. The curation system 104 incombination with the curation system 108 also allows users to createvisualizations in connection with the collected social content 202.

Using points, users can rank social media content 206. One way users canrank content is by measuring its influence. Curation system 104 ranksthe influence of social media content by using its own proprietaryalgorithm. The algorithm ranks the influence of social media content, ascontent is inserted onto the database, by providing a point score.

Points measure influence within the context of a social mediaconversation. With Points the influence of both who is speaking and whatis being said can be measured. Points measures the influence of authorsas well as the influence of the content shared on social media itself.

In one embodiment, the point system can use different factors togenerate points for each content resource. There are four factors thatcan be used: the origination of the content resource, the content of thecontent resource (whether its images, text, or video), the number ofsubscribers (followers and friends) of the author of the contentresource or the individual(s) that rebroadcast/reused the contentresource, and the rating of the content resource (likes, favorites,comments, retweets, reply's, shares etc.). A like is an indication by auser that they prefer or they like a content resource. A favorite iswhen a user saves a content resource as a resource that they want tokeep as a favorite. Each content resource can include comments by otherusers. A retweet is when a content resource is broadcast again by adifferent user. A share is when a user shares a content resource withone or more other individuals. Each of these likes, favorites, comments,retweets, replys, shares, etc can be counted for each content resource.Curation system 104 can combine these factors and these counts in anumber of ways to determine the score, for example adding them ormultiplying them.

In one embodiment, a weight can be assigned to different factors aswell, for example, a weight of 3 may be added for a content resourcethat is liked versus a content resource that is not. Curation system 104can apply the weight to each resource's count for example in determiningthe point score.

Curation system 104 can keep track of all the relevant data within aconversation, and utilizes the data to estimate the attention given toany author or piece of content.

The algorithm updates the Points score for social media content atpredefined intervals to constantly serve the most real-time Pointsscore, as shown in FIG. 3 . FIG. 3 displays one piece of content 300.The points score shown is ZPoints 302. In this example, the Points arecalled ZPoints but can be called by any name. The Points scores areupdated in real-time to reflect the potentially rapid additions,changes, etc. to social media conversations. Items, authors and feeds'influence are accumulated over time to show cumulative totals ofinfluence for each item, author or feed.

In one embodiment, social media content can be curated. In a curationqueue in curation system 104, users can view content and determine anaction to take on that content. The curation queue provides its userswith the ability change the status of social media content, or contentresources, with status such as Pending, Approved, Rejected, Spam, Q&A.Users can tag each content piece or content resource. Tagging is theability to take social media content and append additional metadata.Tagging is done in order to classify and organize social media contentso that the system can serve up the most applicable social media contentalongside the appropriate advertisements. Tagged social media content208 can then be created. The tagged social media content 208 can bematched with ad content 210 by an ad manager 212. A content display 214can be generated with the tagged social media content 208 and the adcontent 210.

FIG. 4 shows a curation queue 400 with tagging functionality. Curationsystem 104 tags social media content by providing a taggingfunctionality. The tagging functionality provides for various taggingfeatures. Manual text Tagging is a feature to allow users to manuallytag social media content. Intelligent Text Tagging is feature toauto-tag text-based social media content.

The process to manually tag can be summarized in four steps. The useridentifies content to be tagged in the curation queue. The user clicksthe “tag it” button associated with the item. Engagement system 108 canprompt the user to type in a keyword in a free-form text field.Engagement system 108 appends that keyword metadata to the social mediacontent resource and save the tag in the “Tag It” Library. Curationsystem 104 can store the keyword metadata appended to the social mediacontent resource.

Intelligent image tagging is a feature to auto-tag image-based socialmedia content. The process to intelligent image tagging can besummarized in four steps. Curation system 104 automatically identifiesan image within the social media content resource to be tagged in thecuration queue. Curation system 104 leverages image recognition services(internally or via third party API) to processes and recommend tags.

Curation system 104 can include an image recognition service that canidentify objects in images (logos, Places, Faces, Products, Text). Theobjects can be sent to a service to be identified. For example, a thirdparty service that can identify objects in images. In anotherembodiment, a database can be would be used as a service, that wouldmatch database object, which would be pre-tagged with metadata. Thesedatabase objects, would then be compared against image objects. If amatch is made, then the tags from the database objects are copied ontothe image object.

The service then provides us additional information in the form of tags(metadata) for the objects through the API back to curation system 104.

Curation system 104 can access a “Tag It Library” to retrieve anyexisting and applicable tags or creates a new tag to append as metadatato the specific social media item (image). A user can override or adjustthe tag that was automatically associated with the image forverification and accuracy.

In one embodiment, in the manual tagging process, a user is able toclick on a “Tag It” button in the curation queue, as well as being ableto create tags, and use existing tags, and attach one or more tags tosocial media content. A use can click on a “Done” button in order tosave the selected tag(s). As shown in the example, the tag can thenappear alongside the actions in the “Tag” column ‘Food’ as shown in thetag 502 of FIG. 5

By saving the selected tag, the social media content can appear underthe “Tagged Items Queue” 602 as shown in FIG. 6 . If a user needs toremove a tag from an item they can do so from the “Tagged Items Queue”by clicking the “x” alongside the content. Once a tag is added to socialmedia content, it is instantly available for use by curation system 104.

In one embodiment, curation system 104 provides the ability to createcontent displays, or they may be called Social Mashups, which are acombination of various data: curated, tagged social media content (textand images) ranked by points and advertisements (uploaded through thecuration system 104 or integrated through 3^(rd) party ad engines).

Curation system 104 allows users to bring together relevant andinfluential data, based on points scores, social media content frommultiple platforms and conversations by selecting: 1. A layout todisplay social media content alongside relevant ads 2. social contenttypes: trends clouds, streaming social content, and streaming Socialpictures 3. ad content, and 4. conversation source, which are feeds.

A feed is a social media conversation defined by designated search termsi.e. keywords, #hash tags and @handles. The feed includes social mediadata that is curated.

Trend clouds are visual depictions of frequently used words in socialmedia conversations. Streaming social content relates to scrolling textdisplaying the curated and tagged text. Streaming social pictures arerevolving photos displaying the curated and tagged images. Again, allinfluential social media content would be ranked and selected to be usedwith points.

A content display combines various data; curated, tagged social mediacontent (text and images) ranked by points, and advertisements (uploadedthrough content curation system 104 or integrated through 3^(rd) partyad engines).

In one embodiment, to build a content display a user can select a layoutthat includes advertisements. A content display 700 is shown in FIG. 7 .A user can configure the content display, within the selected layout 800as shown in FIG. 8 .

Advertisements can be configured through the ad content by defining anad campaign and associating a tag to an ad campaign. A user can definethe ad campaign and associate one or more tags to each ad campaign.

A user is able create a new ad campaign and to associate the campaignwith a tag previously established through the curation queue. Users canalso create a brand new tag within this step. A new ad 900 is shown inFIG. 9 . Users can also leverage a “Tag It” library, which savespreviously saved tags.

FIG. 10 is an ad widget 1000 within the content display. A user can tocreate multiple “Ads” to appear in the ad content area 1002 shown inFIG. 10 . All tags selected for this ad campaign can appear in the areabelow the ad campaign image.

In one embodiment, a user can connect a feed (for example: Collected,Ranked and Approved social media content within the Curation Queue) forthe ad content. The user can associate any of the previously createdfeeds with the ad campaign. This can establish the social media contentto be synchronized.

In one embodiment, a user creates an ad campaign including a campaignname, tags, URLs, and an image. Then the user can configure an adcontent area in the content display or layout, and in the contentdisplay the user can select one or more tags and a feed to associatewith the ad content area of the content display. Therefore once datafrom a feed, either an image or text is shown in the data portion of thecontent display, and the tags is associated with tags, if the tags matchthe tags that the user selected for their ads when they created the ads,the ads are then shown in the ad content area next to the content.

In one embodiment, when a user configures a part of the layout for anadvertisement, the user can select one or more tags and a feed toassociate with the section of the layout.

FIG. 11 is a widget feed configuration 1100. The widget feedconfiguration 1100 is the ad widget on the layout where the useractually determines what tags 1102 to use and the feed 1104. The usercan also crate the new ad campaign here as well by clicking on New Add1106. As shown in FIG. 11 , the user can also select from the dropdown1108 whether the user wants to use streaming social content or streamingsocial pictures.

In one embodiment, social media content can be configured to sync to adcontent. First, the user selects social media content. The user mustselect either streaming social pictures or the streaming social contentto sync with their ads. Then the user selects a feed. For example, auser can pick a feed for the photo content 1200 as shown in FIG. 12 .

FIG. 13 is a sequence diagram 1300. In a first step, the ad content ofthe content display, or the Ad Widget 1302 of the layout initializescommunication with a list of campaigns. The Ad Widget 1302 queries foran “Ad Campaign” from the “Ad” Library. The Ad Widget 1302 receives the“Ad Campaign” from the “Ad” Library. The Ad Widget 1302 extracts the AdCampaign's tag attribute and notifies the “Social Media Widget” of the“Tag” to use for retrieval of social media content. The Ad Widget 1302serves up the Ad Campaign imagery, along with the Ad Campaign hyperlinkonto the content display.

In a second step, the social media widget 1304 responds to thecommunication. It queries approved social media items from the “Tag ItLibrary” for batches of a predetermined number of one or more taggeditems. For example the predetermined number can be 4. If the systemfinds more than a predetermined number of tagged social media items fora specific campaign, for example if the predetermined number is 4, andit found 6 items, the system grabs the necessary number of items for therotation and recycled amongst Tagged Social Media items. It receives thetagged items from the Tag It Library. It displays items for designatedbatch on the content display, or Social Mashup as is described in thefigure. Once all social media items have been displayed for an adcampaign, the Social Media Widget 1304 notifies the Ad Widget 1302 toquery for the next “Ad Campaign”, hence starting the process again.

In one embodiment, if the system does not find any tagged items, thesystem will retrieve a predetermined number of untagged social mediaitems from the approved queue to display. If the system finds less thana predetermined number of tagged items (i.e. a set of 3), the systemwill retrieve the remaining social media items (1 in this case) from theapproved queue in order to complete its batch, while an ad campaign isdisplayed.

FIG. 14 illustrates a flowchart of an example process 1400. The processmay be implemented by curation system 104 or engagement system 108.

At stage 1410, social media data is filtered for content resources thatmatch one or more search terms. A user can generate one or more filtersby using search terms. The search terms can be used to search socialmedia data such as the data on Facebook, Instagram, and Twitter. Theterms are compared to each piece of data on these platforms and if theterms match or are responsive to the content, the content is pulled fromthese platforms. In one embodiment, a hashtag or any other symbol can beused a part of the search terms.

At stage 1420, a feed is generated based on the filtering, wherein thefeed includes the content resources that match the search terms. Theuser can generate multiple feeds based on different search terms. Asingle feed can also include multiple search terms. Once a feed isgenerated which includes one or more search terms, it can becontinuously updated to include any new content resources that match orare responsive to the search terms in the feed.

At stage 1430, a content resource tag with is associated each contentresource, the content resource tag describing the content resource. Thetag can be associated with the content resource in a number of ways asdescribe above. The user can manually tag each content resource based onthe text or the images in the content resource. The user can select oneor more tags to use to tag the content resource. In one embodiment, thecontent resources can be automatically tagged using text recognitionand/or image recognition. The tags are words that are similar to thetext found in the text recognition. In one embodiment, the tags arewords used to describe the image or images in the content resource.

At stage 1440, the feed is associated with a first section of a layoutof a content display. The content display may be the content display 700of FIG. 7 . A user can select a layout of a content display. The contentdisplay can include one or more section and the sections can bepopulated with feed data, text or advertisement data. The user candesignate where the feed data will be displayed on the content display.The user can also designate where the advertisements will be displayedon the content display. The first section can for example include awidget or a content widget with the functionality described.

At stage 1450, an advertisement campaign is associated with a secondsection of the layout of content display, wherein the advertisementcampaign includes one or more campaign tags and an advertisement image.The user can select the advertisement campaign to associate with thesecond section of the layout of the content display. The user can selectto show more than one advertisements and therefore associate onecampaign with one section of the layout and a second campaign with asecond section of the layout. The second section can for example includea widget or an ad widget with the functionality described.

At stage 1460, the layout to be displayed is provided on a displaydevice. The layout includes the various sections of text andadvertisement data.

At stage 1470, the content resources from the feed are provided to bedisplayed in the first section of the layout, wherein each contentresource is displayed in the layout for a predetermined amount of time.When the layout is provided, the data displayed in the layout iscontinuously changing and updating. The section of the layout thatincludes the feed data displays the content resources from the feed,where each item is shown at a preset interval. If more than one sectionis associated with a feed, then the data from the second feed is shownin that section.

At stage 1480, a determination is made that one of the content resourcescurrently displayed in the first section of the layout is associatedwith a content resource tag that matches one of the campaign tags of theadvertisement campaign. Curation system 104 may determine that a contentresource, such as an image is displayed, that is associated with acontent resource tag, such as a metadata tag, describing the contentresource that matches one of the campaign tags of the advertisementcampaign generated by a user. Curation system 104 can compare thecampaign tag with the content resource tag to make this determination.

At stage 1490, the advertisement image is provided to be displayed inthe second section of the layout based on the determining, wherein theadvertisement image is displayed simultaneously with the contentresource in the first section. When curation system 104 determines thatthe two tags match, or the two tags are a close match, the advertisementimage associated with the ad campaign of the campaign tag is provided tobe displayed in the layout of the content display. The advertisement isdisplayed while the content resource with the matching tag is displayed.

In one embodiment, the curation system 104 and/or engagement system 108can be used for creating and visualizations. It provides a way for bothnon-technical users and developers to customize visualizations.Visualizations created within the system can be embedded in any webpage. It also provides a novel way of loading the visualizations tominimize the amount of data that must be transferred.

The curation system 104 may be a visualization instance manager asdescribed herein.

The engagement system 108 may be a server visualization loader. Theserver visualization loader can include a visualization controller andgenerated visualization style. The visualization controller can beJavaScript and get as input visualization data sources and visualizationstructure which can be html. The generated visualization style can beCSS, and can receive the visualization settings, the visualizationstyle, and the global less library.

Every visual has an underlying template. The template defines a defaultHTML/CSS/JS implementation. It also has a set of settings that can beconfigured including colors, text, and images. The templates are groupedinto categories for organizational purposes. A template can also havethemes. Each theme provides one or more of HTML/CSS/JS. Theseimplementations will override the template implementation when thattheme is selected. Template settings provide a definition for all of theconfiguration options available for a given template. These definitionsinclude type of setting, default value, and validation requirements. Aninstance is a concrete implementation of a template. An instance canalso define one or more of HTML/CSS/JS. If any of these are defined onthe instance, the will overwrite what is defined on the theme ortemplate. The instance also contains a set of setting values. This setcontains values for the definitions found in the template settings aswell as custom settings defined for that specific instance. Data sourcesdefine what data is going to be available for the instance. Data sourcescan be searches within Zoomph, analytical data, or external API's.

In one embodiment, the curation system 104 or engagement system 108 canperform a process that includes filtering social media data for contentresources that match one or more search terms. The social media data canbe a part of a social media feed. The process can further includeproviding the content resources to a user interface of a client device.The process can further include receiving a selection of one or more ofthe content resources. The process can further include receiving aselection to create a new visual based on data received; creating avisualization instance; and providing the visualization instance to bedisplayed on the user interface. The visualizations template can beselected by the user to be displayed. The visualizations can bedisplayed on a number of different user interfaces. The process in whichthe visualizations are built is described further below.

In one embodiment, the curation system 104 or engagement system 108 canperform a process that includes filtering social media data for contentresources that match one or more search terms; receiving visualizationsettings at a server visualization loader; identifying visualizationdata sources; creating a visualization controller from the visualizationdata sources, visualization structure and visualization settings;providing to a visualization instance manager the visualizationcontroller and generated visualization style; and creating with thevisualization instance manager a visualization instance based on thevisualization controller and generated visualization style.

In another embodiment, the curation system 104 or engagement system 108can perform a process that includes electing all elements on a webpage,by a client loader, that have a first attribute and make a request to aserver loader for a visualization manager, including the value of all ofthe attributes. for each of the visual identifications sent with therequest, look up the html, less, js, settings, and data sources by aserver loader; running, at the server loader, each of a number of stylesthrough a style generator with the associated settings; building by theserver loader, the client instance manager and injecting the generatedstyles with the controllers; Appending the styles for each of the loadedinstances into a head of the webpage by the client instance manager;Wait for the page to finish loading its own elements at the clientinstance manager; Expose an API for interacting with instances at theclient instance manger; and Construct each of the Visual Instances usingthe controller at the client instance manager.

In another embodiment, the curation system 104 or engagement system 108can perform a process that includes filtering social media data forcontent resources; providing the content resources to a user interface;receiving a selection to create a new visual based on the contentresources; creating a visualization instance based on settingsassociated with the new visual; and providing the visualization instanceto be displayed on the user interface.

In another embodiment, the curation system 104 or engagement system 108can perform a process that includes identifying social media data forcontent resources based on preferences; receiving a selection to createa new visual for the content resources; identifying advertisementsassociated with the content resources; creating a visualization instancefor the advertisements or the content resources based on settingsassociated with the new visual; providing the visualization instance tobe displayed on the user interface. A user can select to create a visualfor the advertisements in addition to the social media contentresources.

The visualizations are seamlessly integrated into a webpage selected bythe user.

In one embodiment, there is an advanced edit screen for thevisualizations. From here a user can edit the raw value of the settingsthey saw in the other screens, edit the data sources (ties in with theprecompute backend) and edit the structure/style/functionality.

Every visual that a user can create is tied to a Template. A templateprovides a default structure/style/functionality. Templates can have oneor more Themes. Each theme can override one or more of thestructure/style/functionality. After a new visual is created through theprocess I outlined in the previous document, one or more of thestructure/style/functionality can be overridden through the AdvancedEdit screen seen below.

Settings that start with an ‘@’ will be used to override the lessvariables that are in the first few lines of the CSS pane.

The JavaScript pane it defines a single constructor function. Thisfunction takes:

-   -   InstanceId—unique id within the system    -   Elem—the DOM element on the client page where the visual is to        be placed    -   HTML—all the code that is defined in the HTML page    -   Config—a key/value pair of all the settings that are not        prefixed with an ‘@’    -   DataSources—all of the data sources defined in the data sources        pane

The first step of the visualization loader is to retrieve all of theinformation relating to each visual from the database. This dataincludes the id, structure (html), style (less),functionality/controller (j s), controller settings, style settings(less variable), and data sources.

Data sources correlate to data endpoints within the back end. Thesecould return searches in Zoomph data, analytical information, or hooksinto external API's. Zoomph searches and analytical information areimplemented using the pre-compute backend.

In one implementation, the visualization manager does the following inorder: 1) Load any additional external resources required by thevisualization instances, 2) Inject the styles for each of the instancesinto the client page's head 3) Wait for the page to finish loading 4)Run the constructor for each of the visualization instances.

In another implementation, there will be an API for each visual instanceso that external JavaScript on the page can interact with individualinstances. Some of the operations that can be performed include:Destroy/Remove instance from page, Reload instance, Instance specificmethods (i.e. programmatically triggering actions that would normally betriggered through user input)

System 100 may be software, firmware, or hardware or any combinationthereof in a computing device. A computing device can be any type ofcomputing device having one or more processors. For example, a computingdevice can be a computer, server, workstation, mobile device (e.g., amobile phone, personal digital assistant, navigation device, tablet,laptop, or any other user carried device), game console, set-top box,kiosk, embedded system or other device having at least one processor andmemory. A computing device may include a communication port or I/Odevice for communicating over wired or wireless communication link(s).

Computing devices such as a monitor, all-in-one computer, smart phone,tablet computer, remote control, etc., may include a touch screendisplay that accepts user input via touching operations performed by auser's fingers or other instrument. For example purposes, a touch sensorgrid may overlay the display area. The touch sensor grid contains manytouch sensitive areas or cells that may be used to locate the areaclosest to the input of a user's touch.

Example touch operations using a touch screen display may include (butare not limited to) pinching, finger (or other stylus or object)touches, finger releases, and finger slides. Finger slides may becircular or any other shape, direction or pattern. The touch screendisplay may include a screen or monitor that may render text and/orimages.

FIG. 15 is an example computer system 1500 in which embodiments of thepresent disclosure, or portions thereof, may be implemented ascomputer-readable code. For example, the components of systems 104 and108 may be implemented in one or more computer systems 1500 usinghardware, software implemented with hardware, firmware, tangiblecomputer-readable media having instructions stored thereon, or acombination thereof and may be implemented in one or more computersystems or other processing systems. Components in FIGS. 1-14 may beembodied in any combination of hardware and software.

Computing devices, such as devices 110 or server 120, may include one ormore processors 1502, one or more non-volatile storage mediums 1504, oneor more memory devices 1506, a communication infrastructure 1508, adisplay screen 1510 and a communication interface 1512.

Processors 1502 may include any conventional or special purposeprocessor, including, but not limited to, digital signal processor(DSP), field programmable gate array (FPGA), application specificintegrated circuit (ASIC), and multi-core processors.

GPU 1514 is a specialized processor that executes instructions andprograms, selected for complex graphics and mathematical operations, inparallel.

Non-volatile storage 1504 may include one or more of a hard disk drive,flash memory, and like devices that may store computer programinstructions and data on computer-readable media. One or more ofnon-volatile storage device 1504 may be a removable storage device.

Memory devices 1506 may include one or more volatile memory devices suchas but not limited to, random access memory. Communicationinfrastructure 1508 may include one or more device interconnection busessuch as Ethernet, Peripheral Component Interconnect (PCI), and the like.

Typically, computer instructions are executed using one or moreprocessors 1502 and can be stored in non-volatile storage medium 1504 ormemory devices 1506.

Display screen 1510 allows results of the computer operations to bedisplayed to a user or an application developer.

Communication interface 1512 allows software and data to be transferredbetween computer system 1500 and external devices. Communicationinterface 1512 may include a modem, a network interface (such as anEthernet card), a communications port, a PCMCIA slot and card, or thelike. Software and data transferred via communication interface 1512 maybe in the form of signals, which may be electronic, electromagnetic,optical, or other signals capable of being received by communicationinterface 1512. These signals may be provided to communication interface1512 via a communications path. The communications path carries signalsand may be implemented using wire or cable, fiber optics, a phone line,a cellular phone link, an RF link or other communications channels.

Examples of systems, methods, and apparatus for collecting and curatingsocial media content, and synchronizing displays of selected items ofsocial media content and related advertisements are described in U.S.patent application Ser. No. 13/801,564, filed Mar. 13, 2013, which isincorporated herein by reference in its entirety and for all purposes.

Existing systems for displaying advertisements do not provide thecapability to synchronize the display of advertisements with relateditems of social media content at venues where live events are held.Systems and methods described herein advantageously provide thecapability to synchronize the display of advertisements with relateditems of social media content at venues where live events, such assporting events, conferences, concerts, etc., are held.

FIG. 16 shows a social content and advertisement synchronization systemin accordance with an embodiment. System 1600 includes a network 1605, acontent acquisition manager 1620, a storage 1630, a curation system1640, a plurality of display devices 1650-A, 1650-B, etc., a displaymanager 1660, and an engagement application 1670.

Network 1605 may include, without limitation, the Internet and/or othertypes of networks such as a wireless network, a wide area network (WAN),a local area network (LAN), an Ethernet network, a storage area network,etc.

Content acquisition manager 1620 is connected to network 1605. Contentacquisition manager 1620 accesses sources of social media content andsearches for items of social media content that satisfy one or moreparameters. For example, content acquisition manager 1620 may accesssocial media websites such as Twitter, Facebook, YouTube, etc., andobtain tweets, messages, comments, images, posted updates, photos,videos, etc., that contain a specified hashtag, contain a specifiedword, contain a specified image, etc. In an illustrative example,content acquisition manager 1620 may search for Facebook posts thatcontain the words “XYZ Company.” Content acquisition manager 1620 maycompile a plurality of items of social media content into a feed.Content acquisition manager 1620 stores items of social media content instorage 1630.

Storage 1630 stores data including items of social media content. Forexample, items of social media content may be stored in a social mediacontent database 1635 maintained in storage 1630.

Curation system 1640 functions in a manner similar to curation system104 described above. Curation system 1640 enables users to access storeditems of social media content and to curate these items in the mannerdescribed above. For example, a user may examine each item of socialmedia content in one or more feeds, and either delete the item, tag theitem, or perform another action with respect to the item. Curationsystem 1640 is similar to curation system 104 described above.

Each display device 1650 is adapted to display text, graphics, and othertypes of content. For example, display devices 1650-A, 1650-B may betelevisions, very large-screen televisions (sometimes referred to asjumbotrons), display screens on computers or cell phones, smart TVs,Internet-enabled TVs, apps on television, etc.

Display manager 1660 access stored items of social media content andcauses the content to be displayed on display devices 1650. Displaymanager 1660 may also cause other types of content, such asadvertisements, to be displayed on display devices 1650.

Engagement application 1670 functions in a manner similar to engagementapplication 108 described above. Thus, for example, engagementapplication 1670 enables a user to access and interact with curationsystem 1640, and to manage social media content, via a user device.

A social content and advertisement synchronization system such as thatdescribed herein may be implemented in a variety of environments. Forexample, a social content and advertisement synchronization system maybe used to collect and curate social media content, and display thecurated social media content along with advertisements on a websiteavailable on the World Wide Web, via a personal computer or via a cellphone application.

In another embodiment, a social content and advertisementsynchronization system may be used to collect and curate social mediacontent, and display the curated social media content along withadvertisements on a display device, in a synchronized manner, at a liveevent such as a sporting event, a conference, a meeting, a concert, aparty, etc.

FIG. 17 shows a venue for a live event in accordance with an embodiment.Sports stadium 1700 includes a field of play 1708, which may be afootball field, a baseball field, a basketball court, an ice rink, etc.,and a spectator area 1710, which typically includes seating, bleachers,etc. A plurality of display devices are disposed at selected locationsin the spectator area 1710. In the illustrative embodiment, the displaydevices include, without limitation, very large-screen jumbotrontelevision screens 1722, regular television screens 1735, and userdevices 1740, which may include cell phones, laptop computers, etc.,carried by individuals. Some user devices 1740 may include a cell phoneapp adapted to receive and display items of social media content, andadvertisements, from system 1600. In other embodiments, other types ofdisplay devices may be used, including smart TVs, Internet-enabled TVs,apps on television, etc.

In accordance with an embodiment, previously curated social mediacontent is displayed on the display devices during the sporting event.FIG. 18 is a flowchart of a method of displaying curated social mediacontent on a display device during a live event in accordance with anembodiment. In the illustrative embodiment, a sports team organization,Team XYZ, uses social content and advertisement synchronization system1600 to collect and curate items of social media content related to TeamXYZ. Thus, in the manner described above, items of social media contentincluding, for example, tweets, posts on personalized social mediapages, photos, blog posts, etc., that mention Team XYZ or are related toTeam XYZ are collected and stored in social media content database 1635.Team XYZ then curates the items by, for example, deleting undesiredcontent items (including, for example, posts using profane language),approving selected content items, tagging selected content items, etc.For example, Team XYZ may add tags to selected items of social mediacontent, such as a tag indicating “fans cheering at Team XYZ game,” atag indicating “fan wearing Team XYZ jersey,” a tag indicating “vehiclewith Team XYZ bumper sticker,” a tag indicating “President Obama at TeamXYZ game,” etc.

Referring again to FIG. 17 , when Team XYZ plays a game in stadium 1700,selected items of social content are retrieved and displayed on thevarious display devices located throughout stadium 1700. Thus, at step1810, a plurality of items of social media content having content tagsmatching one or more predetermined criteria are selected. For example,curation system 1640 or engagement application 1670 may allow Team XYZto specify one or more key words or other parameters, such as “fanscheering at Team XYZ game” and “fan wearing Team XYZ jersey.” Socialmedia content database 1635 is accessed (by curation system 1640 and/orengagement application 1670), and approved items of social media contenthaving tags matching the specified tags are retrieved and used to createa feed. Thus, in the illustrative embodiment, a feed of various photosmay be generated showing fans cheering at Team XYZ games and fanswearing Team XYZ jerseys. The feed may include a sequence of photosand/or photos arranged in a mosaic arrangement.

At step 1820, first items selected from the plurality of items of socialmedia content are displayed, during a live event occurring at a venue,on each of a plurality of large screen display devices disposed atselected locations of the venue. Team XYZ may specify that photos offans at Team XYZ games are to be shown continuously while the game isbeing played, from time to time, or at predetermined intervals. In theillustrative embodiment, display manager 1660 accesses social mediacontent database 1635 and retrieves and displays items of social mediacontent based on the user's input. FIG. 19 shows a photo of fanscheering during a game displayed on a display device 1900, which may bea jumbotron television, for example. In the illustrative embodiment, thephotos in the feed are displayed on jumbotron displays 1722, on TVs1735, and on user devices 1740, while game play is occurring. The itemsin the feed may be displayed on all the display devices in the stadium.Furthermore, photos may be displayed individually in sequence, ormultiple photos may be displayed as a mosaic on each particular screen.As the feed is updated, new or additional photos may be displayed. Thephotos may be displayed using all or a portion of a display screen.

While in the illustrative embodiment, photos are displayed, in otherembodiments, other types of social media content items may be retrievedand displayed, such as tweets, posts, videos, articles, designs, etc. Afeed may include any type of social media content.

Team XYZ may further wish to display advertisements for a team jerseythat is selling in local stores. Thus, prior to the sporting event, anadvertisement campaign for the team jersey, including advertisementimages, for the Team XYZ jerseys, is prepared in the manner describedabove. A tag “fan wearing Team XYZ jersey” is added to the advertisementcampaign. Referring to FIG. 16 , the advertisement images andadvertisement campaign tags may be stored in advertisement campaigndatabase 1638 in storage 1630.

Prior to the sporting event, Team XYZ further specifies that when anyitem of social media content having the tag “fan wearing Team XYZjersey” appears on the display screens, the advertisement imageassociated with the advertisement campaign is to be displayed on thescreen along with the social media content.

At step 1825, a second item having a particular content tag is selectedfrom the plurality of items of social media content. In the illustrativeembodiment, Team XYZ may specify that the photos having a tag “fanwearing Team XYZ jersey” are to be displayed on the display devices at aparticular time during the sporting event—e.g., when halftime begins ina football game, between the second and third innings of a baseballgame, etc. Accordingly, display manager 1660 retrieves items of socialmedia content having a tag “fan wearing Team XYZ jersey.” These itemsmay include photos or other types of content.

At step 1830, an advertisement image having an advertisement campaigntag that matches the particular content tag is identified. Team XYZ alsospecifies that the advertisement image relating to the team jerseyadvertisement campaign, which also has the matching tag “fan wearingTeam XYZ jersey,” is to be displayed along with the photos having thetag “fan wearing Team XYZ jersey.” Display manager 1660 accessesadvertisement campaign database 1638 and retrieves an advertisementimage having the tag “fan wearing Team XYZ jersey.” At step 1840, thesecond item and the advertisement image are displayed, at a selectedtime during the live event, simultaneously on each of the plurality oflarge screen display devices. Display manager 1660 causes the seconditem and the advertisement image to be displayed together at a selectedtime, such as at 2:30 PM during the live event. Alternatively, thesecond item and the advertisement image may be displayed simultaneouslyupon the occurrence of a selected event during the live event.

In the illustrative example, the selected event is the beginning ofhalftime during a football game. Thus, when halftime begins, a photohaving the tag “fan wearing Team XYZ jersey” is selected from the feedand displayed on the display screens in the stadium. FIG. 20 shows aphoto of fans wearing Team XYZ jerseys and an advertisement image forthe Team XYZ jersey displayed on a display device. The photo isdisplayed in a first portion of the screens (e.g., the left side of thescreens), and the advertisement image is displayed in a second portionof the screens (e.g., the right side of the screens), alongside thephoto.

While in the illustrative embodiment, data relating to social mediacontent, advertisement campaign data, and tags are stored in one or moredatabases, in other embodiments, data may be stored in other forms. Forexample, in another embodiment, social media content objects andadvertisement objects may be used to store data. For example, a socialmedia content data store may be created in storage 1630 (or elsewhere)to store a plurality of social media content objects, where each socialmedia content object includes an item of social media content and asocial media content tag. Similarly, a plurality of advertisementobjects may be created and stored in an advertisement campaign store,where each advertisement object storing an advertisement image and anadvertisement campaign tag. Curation system 1640 and/or engagementapplication 1670 may create and manage such objects.

While systems and methods have been described herein in the context of asporting event, the systems and methods described herein may beimplemented in other live events including conferences, concerts,parties, etc. For example, during a conference held at a conferencevenue (e.g., a hotel, a conference center, etc.), a feed of social mediacontent items may be displayed on display screens located at variouslocations in the conference venue. Then, between the presentations oftwo keynote speakers during the conference, selected items of socialmedia content having a particular tag, and advertisements images havingmatching tags, may be displayed simultaneously on the display screens.

Online social networks, such as Twitter, Facebook, YouTube, etc., havebecome important modes of communication in today's world. Manyannouncements, ideas, and other communications are conveyed initially,primarily, and sometimes exclusively, through social networks. In manyindustries, such as marketing, and in other areas of human activity,such as politics, monitoring communications that occur in online socialmedia provides invaluable information. Indeed in today's world, gaugingsentiment on social media is often a crucial component to the success ofmany political campaigns, advertising campaigns, product launches, moviedebuts, celebrity events, etc. However, with the number of daily itemsof social media content on popular topics now frequently exceeding onehundred million, and sometimes exceeding one billion, no existingcommercially available computer or software application is capable ofhandling and analyzing such large amounts of social media contentquickly enough to produce useful results. There is a need for systemsand methods capable of gathering and analyzing very large quantities.

In another embodiment, a visual management system generates a visualinstance, which may then be displayed. FIG. 21 shows a visual managementsystem in accordance with an embodiment. Visual management system 2100includes a network 2105, a visual generation manager 2135, a templatedatabase 2140, a visual instance database 2150, a visual instance loader2170, a display device 2195, a feed module 2180, an analysis module2188, a storage 2114, a curation system 2123, and a user device 2160. Inother embodiments, a visual management system may include othercomponents not shown in FIG. 21 .

Network 2105 may include, without limitation, the Internet and/or othertypes of networks such as a wireless network, a wide area network (WAN),a local area network (LAN), an Ethernet network, a storage area network,etc.

Visual generation manager 2135 provides a user interface that a user mayaccess to create a visual. For example, the user interface may allow auser to select a template and specify one or more settings and otherparameters associated with the selected template. When a user uses atemplate to generate a visual instance, the visual instance is stored invisual instance database 2150.

Template database 2140 stores a plurality of visual templates. Eachvisual template includes information defining selected characteristicsthat may be used to generate a visual instance.

While in the illustrative embodiment of FIG. 21 , a database is used tostore templates, in other embodiments, templates may be stored in adifferent type of data structure or in another manner. For example, adata repository may be used, a data store may be used, etc.

Visual instance database 2150 stores one or more visual instances. Inother embodiments, visual instances may be stored in a different type ofdata structure or in another manner.

Visual instance loader 2170 may from time to time render a visualinstance. For example, visual instance loader 2170 may access a visualinstance stored in visual instance database 2150 and render the visualinstance on a webpage.

Feed module 2180 accesses one or more sources of social media contentand obtains selected items of social media content. For example, feedmodule 2180 may access social media websites such as Twitter, Facebook,Instagram, Google+, etc., and obtain items of social media content suchas, for example (and without limitation), tweets, Facebook posts,comments, messages, blog posts, photographs, videos, etc., which satisfypredetermined criteria. Feed module 2180 aggregates the items of socialmedia content to generate a feed. The feed may include a chronologicalsequence of items of social media content, for example. Feed module 2180may obtain items of social media content and add the items to the feedin real-time or approximately real-time.

Analysis module 2188 analyzes items of social media content in the feedand generates information related to the content. For example, analysismodule 2188 may examine items of social media content mentioning aparticular Company X and generate statistics indicating a firstpercentage of items of content that show a positive sentiment toward thecompany and a second percentage of items that show a negative sentimenttoward the company.

Display device 2195 is a display device capable of displaying a visual.Display device 2195 may be a television, a jumbotron television, adisplay screen of a computer, a touch screen device, a display screen ofa cell phone, etc.

Curation system 2123 functions in a manner similar to curation system1640 described above in the illustrative embodiment of FIG. 16 . Storage2114 stores various types of data. In the illustrative embodiment, anadvertisement campaign database 2117, which stores information for anadvertisement campaign, including advertisement images, is stored instorage 2114. A social media content database 2118, which may include,for example, tagged items of social media content, is also stored instorage 2114.

User device 2160 is a computer or other processing device that a usermay employ to access visual generation manager 2135 to create a visualinstance, for example.

In accordance with an embodiment, visual templates are created a priori.Each visual template is directed at a particular type of visual (e.g., atemplate for generating and displaying a heat map of social mediaactivity, a template for generating and displaying a line graphindicating mentions in social media, a template for retrieving anddisplaying photos selected from the feed, etc.). Referring to FIG. 21 ,several visual templates, including visual template A and visualtemplate B, are stored in template database 2140.

FIG. 22 shows components of a template in accordance with an embodiment.Template 2200 includes a data source generator 2225, a settings module2240, and an HTML/CSS/Javascript component 2250.

Data source generator 2225 uses settings specified by a user andgenerates a data source comprising code (XML). Based on the settingsspecified by the user, data source generator 2225 generates code capableof rendering the visual defined by the specified settings. The codegenerated is referred to as a “data source.”

Settings module 2220 defines one or more settings that a user mayconfigure. For example, the settings module 2220 may indicate that theuser may control the style and color of a title or banner appearing onthe visual. Settings module 2220 may indicate that a user may selectpossible time intervals (real-time, day, week, month, year, etc.) for aline graph. Settings module 2220 may indicate that a user may selectsocial media web sites from which items of social media content are tobe obtained. Settings module 2220 may indicate that a user may select ageographical area (e.g., continental United States, Southeastern UnitedStates, Northeastern United States, Midwest, Western United States) tobe displayed in a heat map shown in a visual.

HTML/CSS/Javascript component 2250 includes details controlling howelements of a visual instance is rendered. HTML/CSS/Javascriptcomponents are known.

In accordance with an embodiment, a visual instance is generated anddisplayed based on a template selected by a user. FIG. 29 is a flowchartof a method of creating a visual instance in accordance with anembodiment.

In an illustrative embodiment, suppose that Company X wishes to monitorany comments, mentions, or discussions concerning its products or thecompany itself, that occur in social media. For example, it wishes tomonitor mentions of its products, or of the company itself, that appearin tweets on Twitter, posts on Facebook, images on Instagram, posts onGoogle+, etc. Accordingly, a user (who may be an employee of Company X,for example) employs user device 2160 and accesses visual generationmanager 2135 to create a visual.

In the illustrative embodiment, visual generation manager 2135 providesthe user with a selection of templates each of which is a tool forconstructing a visual instance, which in turn is adapted to generate arender a particular type of visual. For example, visual generationmanager 2135 may cause a web page such as that shown in FIG. 23A to bedisplayed on user device 2160. Web page 2300 includes a plurality oftemplates 2303-A, 2303-B, 2303-C, 2303-D, 2303-E, and 2303-F. More orfewer templates may be displayed. Each template is associated with adifferent type of visual. For example, in the illustrative embodiment,Template A is associated with a visual showing a line graph of socialmedia mentions, Template B is associated with a sentiment analysis ofsocial media mentions, Template C is associated with a heat map ofsocial media mentions, etc.

At step 2910, a visual template is selected by a user from a pluralityof stored visual templates, wherein the visual template includes a datasource generator and a settings module. In the illustrative embodiment,the user wishes to generate a visual showing a line graph of socialmedia mentions of Company X, and therefore selects Template A. The usermay select Template A by clicking on the appropriate icon displayed onthe screen, for example. Visual generation manager 2135 receives theuser's selection.

Each template requires the user to enter one or more parameters(referred to as settings) in order to generate a visual instance.Accordingly, at step 2920, a user interface indicating one or moresettings that must be specified to create the visual instance isprovided. In the illustrative embodiment, visual generation manager 2135provides to the user one or more web pages which prompt the user toselect one or more settings. FIGS. 23B-23E show web pages that prompt auser to specify various settings in accordance with an embodiment. FIG.23B shows a page 2310 that prompts the user to select text for a banner.The user may enter text in a field 2314. In the illustrative embodiment,the user enters the text “Company X”. FIG. 23C shows a page 2330 thatincludes a line 2333 prompting the user to select a color for thebanner, and a line 2335 prompting the user to select a font for thebanner. In the illustrative embodiment, the user selects the color greenand the font “Times New Roman.” FIG. 23D shows a page 2340 that includesa line 2342 prompting the user to select possible time intervals for theline graph in the visual. The user may select from among “Real-Time,”“Day,” “Week,” “Month,” “Year,” “5-Year,” and “10-year.” In theillustrative embodiment, the user selects “Real-Time,” “Day,” “Month,”and “Year.” FIG. 23E shows a page 2360 that includes a line 2364prompting the user to select the types social media for which data is tobe displayed in the visual. In the illustrative embodiment, the userselects Twitter, Facebook, Instagram, and Google+. In other embodiments,page 2360 may include options for other types of social mediainformation.

At step 2930, settings information specifying the one or more settingsis received from the user. Visual generation manager 2335 receives theuser's selections.

At step 2930, a visual instance is generated and stored in a memory. Atstep 2940, the settings information is saved within the visual instance.At step 2950, a data source is generated within the visual instance.Visual generation manager 2135 generates a visual instance based on theuser's selection of Template A and on the settings specified by theuser. FIG. 24 shows components of a visual instance in accordance withan embodiment. Visual instance 2400 includes a plurality of data sources2410-A, 2420-B, etc., a settings component 2440, and anHTML/CSS/Javascript component 2450. Settings component 2440 includesinformation defining the settings selected by the user (as illustratedherein with reference to FIGS. 23B-23E). HTML/CSS/Javascript component2450 includes details concerning how various elements of the visualinstance are to be rendered. Each respective data source 2410 includescode capable of rendering the visual defined by the settings, or ofrendering an element within the visual. A data source may includefunctionality to access the feed generated by feed module 2180 (or oneof a plurality of feeds generated by feed module 2180), examine selecteditems of social media content in the feed, and render the visual definedby the user-specified settings, or an element of the visual.

Referring to FIG. 21 , the visual instance is stored in visual instancedatabase 2150 as visual instance 2157.

At a subsequent time, the visual instance may be displayed. In theillustrative embodiment, visual instance loader 2170 access visualinstance 2157 and causes the visual instance to be displayed on displaydevice 2195.

When visual instance 2157 is displayed, data sources 2410-A, 2410-B,etc., access a feed generated by feed module 2180. In one embodiment, afeed generated by feed module 2180 may be displayed. FIG. 25 shows apage 2500 which displays a feed. Items of social media content arecaptured from Twitter, Facebook, Instagram, Google+ and displayed onpage 2500. In the illustrative embodiment, items 2512, 2514, 2516 aredisplayed. A user may filter the items in the feed using buttons 2551,2552, 2553, 2554, 2556.

At step 2960, the visual instance is displayed. In the illustrativeembodiment, visual instance loader 2170 causes the visual instance to bedisplayed on a web page shown on display device 2195. FIG. 26A shows aweb page 2600 on which a visual instance is displayed in accordance withan embodiment. The visual includes a banner 2605 that includes the text“Company X,” created based on the user-specified settings. The visualalso includes a line graph 2618 showing social media activity related toCompany X. Specifically, the line graph includes lines 2621, 2623, 2625,and 2627 showing, respectively, a quantity of mentions of Company X onTwitter, Facebook, Instagram, and Google+. Line graph 2618 shows data inreal-time. The visual shown on page 2600 includes a “Real-Time button2612, a “Day” button 2614, a “Month” button 2616, and a “Year” button2618 which allow the user to select a time interval for display. Theuser may select a desired button to view a data for a different timeinterval. If the user selects “Month” button 2616, data showing mentionsof Company X in social media over a month are displayed, as shown inFIG. 26B.

In other embodiments, visuals may display other types of data. In anillustrative embodiment, Company X may select Template B (2303-B), shownin FIG. 23A, to generate a visual showing positive and negativesentiments toward Company X in social media. A user representing CompanyX specifies one or more settings, in a manner similar to that describedabove, and visual generation manager 2135 generates a visual instancebased on the user's settings. The visual instance is stored as visualinstance 2185 in visual instance database 2150. Subsequently, visualinstance loader 2170 displays visual instance 2185 on display device2195. When visual 2185 is rendered, analysis module 2188 examines itemsof social content in a feed generated by feed module 2180 and analyzeseach item to determine whether the item is associated with a positivesentiment or a negative sentiment. Analysis module 2188 determines afirst value representing a percentage of items of social media contentthat show positive sentiment toward Company X, and a second valuerepresenting a percentage of items of social media content that shownegative sentiment toward Company X. The first and second values aredisplayed in a visual. FIG. 27 shows a page 2700 including a visualshowing positive and negative sentiments toward Company X in accordancewith an embodiment.

In another illustrative embodiment, Company X may select Template C(2303-C), shown in FIG. 23A, to generate a visual showing a heat map ofsocial media activity relating to Company X. A user representing CompanyX specifies one or more settings, in a manner similar to that describedabove. For example, the user may specify that the heat map should showinformation for the entire continental United States. Visual generationmanager 2135 then generates a visual instance based on the user'ssettings. The visual instance is stored in visual instance database 2150as visual instance 2185. Subsequently, visual instance loader 2170displays visual instance 2185 on display device 2195. When visual 2185is rendered, analysis module 2188 examines items of social content in afeed generated by feed module 2180 and analyzes each item to determinewhere the item of social content was generated (where the person whocreated the tweet, post, tec., is located). Visual instance 2185 usessuch information to render a heat map of social media activity. FIG. 28shows a page 2800 that includes a visual showing a heat map of socialmedia activity relating to Company X in accordance with an embodiment.In accordance with the settings specified by the user, the heat mapincludes a map 2860 of the continental United States and indicatesvarious-sized circles showing the amount of social media contentgenerated in various cities and regions in the United States.

In another embodiment (not illustrated), a template may be configured togenerate a visual instance that displays tagged items of social mediacontent selected from social media content database 2118, or from afeed, based on one or more criteria. The visual instance may also selectadvertising images having tags that match the selected items of socialmedia content, and display on a display device, simultaneously, theitems of social media content and the advertising images. For example,Company X may select items of social media content that show aparticular product manufactured by Company X, and tag the items with thetag “Product A”. Company X may also prepare an advertisement campaignwith one or more advertisement images for the particular product, andtag the advertisement campaign with the tag “Product A.” The Company maysubsequently select a template and specify that items of social mediacontent having the tag “Product A” are to be selected and displayed. Thetemplate then generates a visual instance adapted to select tagged itemsof social media content and display the items of social media contenthaving the specified tag on a display device. The visual instance isfurther adapted to retrieve advertising images having a matching tag,and to display the advertising images simultaneously on a screen withthe items of social media content. In another embodiment, a visualinstance may be generated that is adapted to select an item of socialmedia content from a feed, identify a topic of the item, selectadvertisement image related to the topic, and display the advertisingimage simultaneously on a screen with the item of social media content.

Advantageously, systems and methods described herein make it possible togather and analyze, in real-time, very large quantities of items ofsocial media content from multiple source of social media content. Forexample, systems and methods described herein may be used to gather andanalyze millions, hundreds of millions, or even billions of tweets,Facebook posts, posts on Instagram, posts on Google+, videos on YouTube,etc., in real-time, or to analyze such data over a selected interval oftime. The ability to handle such very large quantities of social mediacontent is increasingly valuable in today's world. For example, intoday's world, gauging sentiment on social media is now an important, ifnot crucial, component in the success of many political campaigns,advertising campaigns, product launches, movie debuts, celebrity events,etc. Notably, no existing commercially available computer or softwareapplication is capable of handling and analyzing such large amounts ofsocial media content quickly enough to produce useful results.

In another embodiment, templates and/or visual instances may be createdand stored in the form of objects. Objects and object-orientedprogramming are known. For example, templates may be stored as objectsin a template store. FIG. 30A shows a template object store inaccordance with an embodiment. Template object store 3000 holds atemplate object A (3010-A) and a template object B (3010-B). Similarly,visual instances may be stored as objects in a visual instance objectstore. FIG. 30B shows a visual instance object store in accordance withan embodiment. Visual instance object store 3050 holds a first visualinstance object 3056 and a second visual instance object 3058.

In one embodiment, display device 2195 includes a touch screen device.FIG. 31 shows a visual displayed on a touch screen device 3100 inaccordance with an embodiment. Use of a touch-screen display deviceenables a user to specify settings information quickly and easily. Forexample, in the illustrative embodiment of FIG. 31 , a user selects oneor more time intervals for a line graph to be displayed in a visual.

In another embodiment, an individual attending a live event may beidentified. For example, an individual watching a game in a stadium maybe identified based on the individual's ticket purchase. An item ofsocial media content associated with the individual may be selected,wherein the item of social media content has a first tag. Anadvertisement image having a second tag that matches the first tag isselected. A visual instance adapted to display the item of social mediacontent and the advertisement image is generated. During the game, thevisual instance is caused to display the item of social media contentand the advertisement image simultaneously on a display device locatedin the live event (e.g., a display device located in the stadium).

FIG. 32 is a flowchart of a method of displaying social media contentand advertisements in accordance with an embodiment. The method of FIG.32 employs systems and methods described herein and includes stepssimilar to those described herein.

At step 3210, an individual attending a live event taking place in avenue is identified. For example, a person at a sporting event, or at aconference may be identified based on the person's ticket purchase,registration, etc. In another embodiment, an image of an individual inthe crowd at the event may be obtained, and facial recognitioncapability (e.g. facial recognition software) may be employed toidentify the individual.

At step 3220, an item of social media content associated with theindividual is selected, the item of social media content having a firsttag. Items of social media content associated with the individual, suchas photos of the individual, posts from the individual's Facebook page,etc., may be obtained prior to the event or during the event. The itemsmay be tagged and stored in social media content database 2118, forexample.

At step 3230, an advertisement image having a second tag that matchesthe first tag is selected. An advertisement image may be generated andtagged in the manner discussed above. Tagged advertisement images may bestored in advertisement campaign database 2117, for example.

At step 3240, a visual instance adapted to select the item of socialmedia content and the advertisement image based on the tag and todisplay the item of social media content and the advertisement imagesimultaneously is generated. The visual instance may be generated priorto the live event, or during the event. At step 3250, the visualinstance is caused to display the item of social media content and theadvertisement image simultaneously on a display device located in thestadium. At a selected time during the event, visual instance loader maycause the visual instance to display the selected social media contentand the advertisements. For example, during a sporting event at astadium, the individual's social media content and advertisements may bedisplayed on a jumbotron television screen.

In various embodiments, opt-in and opt-out options may be provided tousers, participants, consumers, and to other individuals to protectprivacy rights. For example, persons attending a live event may beprovided an option to “opt out” of participating in the system. Thus, byopting out, an individual may indicate that he or she does not wish tohave his or her social media content accessed and/or used in connectionwith an advertisement or for any other reason. Such opt-in and opt-outoptions may be provided at the time of a ticket purchase, for example,via a web page on the Internet, etc.

In many fields, generating an accurate prediction for an unknownvariable based on one or more known variables can provide valuableinformation. For example, predicting demographic information for 30,000people in a stadium, based on limited information concerning theindividuals in the crowd, can be very helpful in selecting appropriateadvertisements to be displayed on display screens (including “jumbotron”television screens, for example) located in the stadium. In anotherexample, knowledge of the demographics of people reacting to a marketingcampaign on social media can be helpful in market research. However, inmany instances obtaining accurate information can be difficult. Someexisting systems generate a prediction for an unknown characteristic byusing simple predictive formulas. For example, many systems use amajority-based predictive method to assign characteristics toindividuals in a group. For example, such a system might use the factthat 72% of people having the first name “Taylor” are female (although28% of people having the first name “Taylor” are male) and assign“Female” to any individual in the group having the first name “Taylor.”Clearly, for any particular individual named “Taylor,” there is asignificant probability that such a system will produce an incorrectresult.

Accordingly, there is a need for systems and methods capable ofproducing more accurate predictions of demographic information forindividuals in a target audience.

FIG. 33 shows a demographic data gathering and advertisement deliverysystem in accordance with an embodiment. System 3300 includes a network3305, a feed 3320, a storage 3330, a curation system 3340, a displaydevice 3350, a display manager 3360, and an engagement application 3370.System 3300 also includes an analysis module 3390.

Network 3305 may include, without limitation, the Internet and/or othertypes of networks such as a wireless network, a wide area network (WAN),a local area network (LAN), an Ethernet network, a storage area network,etc.

Feed 3320 includes items of social media content obtained from sourcesof social media content that satisfy one or more parameters. Forexample, feed 3320 may include items of social media content obtainedfrom social media websites such as Twitter, Facebook, YouTube, etc.

Storage 3330 stores data including items of social media content. Forexample, in the illustrative embodiment, items of social media contentmay be stored in a social media content store 3335 maintained in storage3330. Storage 3330 includes an advertisement campaign store 3336 thatholds data, including advertisement images, relating to variousadvertising campaigns. In the illustrative embodiment storage 3330 alsoincludes a probability distribution store 3338 which stores variousprobability distributions, and a prediction set store 3339 that holdsdata relating to one or more prediction sets. In other embodiments,other storage methods and other data structures may be used to storedata relating to items of social media content, probabilitydistributions, and prediction sets.

Curation system 3340 functions in a manner similar to curation system104 described above. Curation system 3340 enables users to access storeditems of social media content and to curate these items in the mannerdescribed above. For example, a user may examine each item of socialmedia content in one or more feeds, and either delete the item, tag theitem, or perform another action with respect to the item.

Display device 3350 is adapted to display text, graphics, and othertypes of content. For example, display device 3350 may be a television,a very large-screen television (sometimes referred to as a jumbotron), adisplay screen on a computer or cell phone, etc.

Display manager 3360 accesses stored items of social media content andcauses the content to be displayed on display device 3350. Displaymanager 3360 may also cause other types of content, such asadvertisements, to be displayed on display device 3350.

Engagement application 3370 functions in a manner similar to engagementapplication 108 described above. Thus, for example, engagementapplication 3370 enables a user to access and interact with curationsystem 3340, and to manage social media content, via a user device.

Analysis module 3390 analyzes data relating to a group of people andgenerates predictions concerning demographic characteristics of thegroup. For example, analysis module 3390 may analyze data related to acrowd in a stadium and generate predictions concerning the demographicmakeup of the people in the crowd.

FIG. 34 shows components of an analysis module in accordance with anembodiment. Analysis module 3390 includes a feature analysis 3408, aprobabilistic classifier 3410, a Monte Carlo Method 3430, and a randomnumber generator 3426. Feature analysis 3408 may identify an individualwithin a group of individuals based on one or more parameters. Forexample, feature analysis 3408 may examine all ticketholders among acrowd at a stadium and identify a ticketholder who resides in aparticular state, who has a particular last name, etc. Feature analysis3408 may also define features relating to selected characteristics ofvarious individuals. For example, feature analysis 3408 may definevarious levels of income and predict a particular level of income for anindividual based on other features such as name, state of residence,etc. Random number generator 3426 from time to time generates a randomnumber, for example, when required by another component of analysismodule 3390.

Probabilistic classifier 3410 includes a probabilistic classifier thatis able to predict, given a sample input, a probability distributionover a set of classes. Probabilistic classifiers are known.Probabilistic classifier 3410 may include any one or more of a varietyof probabilistic classifiers. For example, probabilistic classifier 3410may include a Naïve-Bayes method.

Monte Carlo method 3430 applies a Monte Carlo method computationalalgorithm that relies on repeated random sampling to obtain numericalresults. Monte Carlo methods are known. Monte Carlo method 3430 mayinclude any one or more of a variety of Monte Carlo methods.

In accordance with an embodiment, demographic data gathering andadvertisement delivery system 3300 generates a plurality of predictionsets representing predictions for selected items of demographicinformation for a defined group of individuals. In an illustrativeembodiment, suppose that it is desirable to the manager of a venue (suchas a stadium) to identify an individual in a crowd at the venue, definea set of one or more known characteristics of the individual such asname, state of residence, etc., and predict an income level for theindividual based on the known information. FIG. 35A is a flowchart of amethod of generating a plurality of prediction sets for an individual inaccordance with an embodiment. The method described herein may berepeated for a plurality of individuals at a venue to produce aplurality of prediction sets for various individuals at the venue. Theprediction sets may then be used to generate predictions for particularindividuals or for a group of individuals at the venue.

At step 3510, an individual having a plurality of first features isidentified. In an illustrative embodiment, feature analysis 3408examines the people attending a sporting event at a stadium, based ontheir ticket purchases, registration information, or other availabledata. Specifically, in an illustrative embodiment, feature analysis 3408examines the following characteristics: (1) first name, (2) last name,and (3) state of residence. Suppose in particular that among the crowdattending the sporting event, feature analysis 3408 identifies anindividual who has (1) the first name “James,” (2) the last name“Smith,” and who (3) resides in the State of New Jersey.

At step 3530, for each first feature among the plurality of firstfeatures, a respective first probability distribution indicating, foreach respective second feature among a plurality of second features, aprobability that a person having the respective second feature has therespective first feature, is determined, thereby generating a pluralityof first probability distributions.

In the illustrative embodiment, because a prediction of the individuals'income level is desired, feature analysis 3408 defines a variety ofpossible income levels that an individual may have, including zero (0)to $30,000, $30,001 to $50,000, $50,001 to $80,000, $80,000 to $125,000,125,000 to $250,000, and greater than $250,000.

Probabilistic classifier 3410 now accesses probability distributionstore 3338 and retrieves a probability distribution indicating, for eachof the defined income levels, a probability that a person at therespective income level may have the first name “James.” The probabilitylevel may represent probabilities for a selected population, such aspeople in the United States, for example. In one embodiment, eachrespective probability distribution may be scaled to ensure that the sumof all probabilities in the distribution equals one.

FIG. 36A shows a probability distribution 3610 indicating probabilitiesthat a person at a respective income level may have the first name“James,” in accordance with an embodiment. Specifically, an individualhaving an income between zero and $30,000 has a 0.5% probability ofhaving the first name “James,” an individual having an income between$30,001 and $50,000 has a 0.9% probability of having the first name“James,” an individual having an income between $50,001 and $80,000 hasa 0.5% probability of having the first name “James,” an individualhaving an income between $80,001 and $125,000 has a 1.0% probability ofhaving the first name “James,” an individual having an income between$125,001 and $250,000 has a 1.3% probability of having the first name“James,” and an individual having an income greater than $250,000 has a0.8% probability of having the first name “James,”

The income levels and probabilities shown in FIG. 36A are purelyillustrative. Alternatively, probabilistic classifier 3410 may generatea probability distribution, if necessary.

Probabilistic classifier 3410 accesses probability distribution store3338 and retrieves a probability distribution indicating, for each ofthe defined income levels, a probability that an individual at therespective income level may have the last name “Smith.” FIG. 36B shows aprobability distribution 3620 indicating probabilities that a person ata respective income level may have the last name “Smith,” in accordancewith an embodiment. Specifically, an individual having an income betweenzero and $30,000 has a 0.8% probability of having the last name “Smith,”an individual having an income between $30,001 and $50,000 has a 1.2%probability of having the last name “Smith,” an individual having anincome between $50,001 and $80,000 has a 0.4% probability of having thelast name “Smith,” an individual having an income between $80,001 and$125,000 has a 0.6% probability of having the last name “Smith,” anindividual having an income between $125,001 and $250,000 has a 0.9%probability of having the last name “Smith,” and an individual having anincome greater than $250,000 has a 1.1% probability of having the lastname “Smith.”

The income levels and probabilities shown in FIG. 36B are purelyillustrative. Alternatively, probabilistic classifier 3410 may generatea probability distribution.

Probabilistic classifier 3410 accesses probability distribution store3338 and retrieves a probability distribution indicating, for each ofthe defined income levels, a probability that an individual at therespective income level may reside in the State of New Jersey. FIG. 36Cshows a probability distribution 3630 indicating probabilities that anindividual at a respective income level may reside in New Jersey, inaccordance with an embodiment. Specifically, an individual having anincome between zero and $30,000 has a 1.2% probability of residing inNew Jersey, an individual having an income between $30,001 and $50,000has a 0.5% probability of residing in New Jersey, an individual havingan income between $50,001 and $80,000 has a 0.3% probability of residingin New Jersey, an individual having an income between $80,001 and$125,000 has a 1.0% probability of residing in New Jersey, an individualhaving an income between $125,001 and $250,000 has a 0.6% probability ofresiding in New Jersey, and an individual having an income greater than$250,000 has a 0.7% probability of residing in New Jersey.

The probabilities shown in FIG. 36C are purely illustrative only.Alternatively, a probability distribution may be generated.

At step 3535, a second probability distribution indicating, for eachrespective second feature, a probability that a person in a populationhas the respective second feature, is determined. In the illustrativeembodiment, probabilistic classifier 3410 also accesses probabilitydistribution store 3338 and retrieves a fourth probability distributionindicating, for each of the defined income levels, a probability thatany given individual in a population may have that respective incomelevel (independent of other features). For example, probabilisticclassifier 3410 may obtain a probability distribution indicating, foreach defined income level, the probability that a person living in theUnited States has the respective income level. FIG. 36D shows aprobability distribution 3640 indicating probabilities that anindividual in a population may have a respective income level, inaccordance with an embodiment. Specifically, an individual in thepopulation has a 10% probability of having an income between zero and$30,000, a 25% probability of having an income between $30,001 and$50,000, a 30% probability of having an income between $50,001 and$80,000, a 20% probability of having an income between $80,001 and$125,000, a 10% probability of having an income between $125,001 and$250,000, and a 5% probability of having an income greater than$250,000.

The probabilities shown in FIG. 36D are purely illustrative only.Alternatively, a probability distribution may be generated.

At step 3540, a probabilistic classifier is used to generate a mergedprobability distribution based on the plurality of first probabilitydistributions and the second probability distribution. Referring to FIG.34 , probabilistic classifier 3410 combines probability distributions3610, 3620, 3630, and 3640 to generate a merged probabilitydistribution. FIG. 37 shows a merged probability distribution inaccordance with an embodiment. Merged probability distribution 3700indicates there is a 0.008% probability that an individual having thefirst name “James,” the last name “Smith,” and resides in the state ofNew Jersey has an income between zero and $30,000, a 0.005% probabilitythat an individual having the first name “James,” the last name “Smith,”and resides in the state of New Jersey has an income between $30,001 and$50,000, a 0.006% probability that an individual having the first name“James,” the last name “Smith,” and resides in the state of New Jerseyhas an income between $50,001 and $80,000, a 0.007% probability that anindividual having the first name “James,” the last name “Smith,” andresides in the state of New Jersey has an income between $80,001 and$125,000, a 0.009% probability that an individual having the first name“James,” the last name “Smith,” and resides in the state of New Jerseyhas an income between $125,001 and $250,000, and a 0.005% probabilitythat an individual having the first name “James,” the last name “Smith,”and resides in the state of New Jersey has an income greater than$250,000. The probabilities shown in FIG. 37 are purely illustrativeonly.

Probabilistic classifier 3410 also generates a scale 3755 based onprobability distribution 3700 that includes a plurality of numericalranges between zero (0.00) and one (1.00), and establishescorrespondences between ranges of numbers on the scale and respectiveincome levels. For example, probabilistic classifier 3410 may scale theprobability values in probability distribution to define a plurality ofscaled values having a sum equal to one (1.00). In the illustrativeembodiment of FIG. 37 , numbers from 0 to 0.200 correspond to the incomelevel between 0 and $30,000, numbers between 0.200 and 0.325 correspondto the income level between $30,001 and $50,000, numbers between 0.325and 0.475 correspond to the income level between $50,001 and $80,000,numbers between 0.475 and 0.65 correspond to the income level between$80,001 and $125,000, numbers between 0.65 and 0.875 correspond to theincome level between $125,001 and $250,000, and numbers between 0.875and 1.00 correspond to income levels greater than $250,000.

In other embodiments, numerical ranges may be scaled differently. Forexample, ranges between zero and one hundred may be used.

Probabilistic classifier 3410 stores merged probability distribution3700 and scale 3755 in probability distribution store 3338.

Referring again to the routine of FIG. 35A, at step 3550, a Monte Carlomethod is used to generate a prediction set based on the mergedprobability distribution, the prediction set including a plurality ofprediction values for the individual, each respective prediction valuerepresenting one of the plurality of second features. In theillustrative embodiment of FIG. 34 , Monte Carlo Method 3430 performs aplurality of tests. Each test includes generation of a random numberbetween zero (0.00) and one (1.000) (referred to as a “test result” or a“prediction value”). Monte Carlo Method 3430 may cause random numbergenerator 3426 to generate a random number for each test. The testresult may be used to identify a position on scale 3755 that correspondsto the test result, and to determine an income level on mergedprobability distribution 3700 that corresponds to the test result. Foreach individual in the group, a plurality of test results, referred toas a “prediction set,” is generated. A prediction set may include anynumber of test results. For example, a prediction set may include100,000 test results, fewer than 100,000 test results, or more than100,000 test results. FIG. 38 shows an illustrative example of aprediction set in accordance with an embodiment. Prediction set 3800includes a plurality of test results including test results 3811 a, 3811b, 3811 c, 3811 d. Each test result 3811 may be placed on scale 3755 ofFIG. 37 to identify a corresponding income level. Thus, in FIG. 38 ,each test result 3811 corresponds to a respective income level 3847.Thus, test result 3811 a corresponds to income level 3847 a, test result3811 b corresponds to income level 3847 b, etc.

In one embodiment, the systems and methods described above may be usedto generate a separate prediction set for each individual in a pluralityof individuals. For example, various individuals in a crowd at a venuesuch as a stadium may be identified, and for each individual, one ormore features may be determined, and a prediction set may be generatedfor the individual. In this manner, a plurality of prediction sets maybe generated for a plurality of people at a venue.

At step 3560, the prediction set is stored in a memory. In theillustrative embodiment of FIG. 33 , Monte Carlo method 3430 stores theprediction set in prediction set store 3339. If multiple prediction setsare generated for a plurality of individuals, a plurality of predictionssets may be stored.

FIG. 35B is a flowchart of a method of generating a plurality ofprediction sets for an individual in accordance with another embodiment.At step 3582, for each first feature among a first plurality of firstfeatures, a respective probability distribution indicating, for eachrespective second feature among a plurality of second features, aprobability that a person having the respective second feature has thefirst feature, is determined, thereby generating a first plurality ofprobability distributions. At step 3584, an individual having a secondplurality of first features is identified. At step 3586, a secondplurality of probability distributions associated with the individual isidentified from among the first plurality of probability distributions,based on the second plurality of first features. At step 3588, aprobabilistic classifier is used to generate a merged probabilitydistribution based on the second plurality of probability distributions.Other probability distributions may also be obtained and used ingenerating the merged probability distribution. At step 3590, a MonteCarlo method is used to generate a prediction set based on the mergedprobability distribution, the prediction set including a plurality ofprediction values for the individual, each respective prediction valuebeing associated with one of the plurality of second features. At step3592, the prediction set is stored in a memory.

In one embodiment, probabilistic classifier 3410 employs a Naïve-Bayesmethod. FIG. 39 is a flowchart of a method of generating a predictionsets for an individual using a Naïve-Bayes method in accordance with anembodiment.

Referring to block 3908, a plurality of a priori frequency distributionsmay be generated and stored. In order to generate one or more scaledconditional probabilities, the a priori distributions are retrieved frommemory.

At block 3910, scaled conditional probabilities of possible labels aredetermined given a feature set. In the illustrative embodiment,probabilistic classifier 3410 determines scaled conditionalprobabilities of possible labels. Scaled conditional probabilities maybe computed based on stored probabilities, which may be accessed andretrieved. For example, in an illustrative embodiment, probabilitydistribution store 3339 stores a plurality of probability distributionswhich may be accessed, and which will allow for the computation of:p(f _(j) |L _(k))

Where

-   -   p(f_(j)|L_(k)) represents the conditional probability of feature        f given characteristic value L_(k)    -   L_(k) represents a particular label value in the domain of        possible label values of the characteristic L being predicted    -   f_(j) represents a particular feature

The determination of scaled conditional probabilities (block 3910) mayinclude methods to calculate the conditional probability of any possiblelabel given the extracted set of features. This computation may be doneusing a Naïve Bayes approximation shown below. The Naïve Bayesapproximation assumes that each of the features are conditionallyindependent for performance benefits. Other embodiments may use adifferent conditional probability computation that does not make thisassumption.

${p^{\prime}\left( {{L_{k}❘f_{1}},\ldots\mspace{11mu},f_{m}} \right)} = {{p\left( L_{k} \right)}{\prod\limits_{j = 1}^{m}\;{p\left( {f_{j}❘L_{k}} \right)}}}$Where

-   -   p′(L_(k)|f₁, . . . , f_(m)) represents the conditional        probability of seeing a characteristic label L_(k) given a set        of features f₁, . . . , f_(m)    -   L_(k) represents a particular label value in the domain of        possible label values of the characteristic L being predicted    -   f_(j) represents a particular feature where there are m possible        features

The computation of conditional probability (block 3910) may also includemethods for scaling of all computed probabilities of the characteristicL on a scale of 0 to 1 such that:

${Y{\sum\limits_{k = 1}^{q}{p^{\prime}\left( {{L_{k}❘f_{1}},\ldots\mspace{11mu},\ldots\mspace{11mu},f_{m}} \right)}}} = 1$Where

-   -   Y represents a scaling factor such that the sum of conditional        probabilities can be scaled to 1    -   q represents the size of the domain of values for characteristic        L

The computation of conditional probability (block 3910) may also methodsfor computing a running sum of the scaled probabilities as follows:

${p^{''}\left( {{L_{k}❘f_{1}},\ldots\mspace{11mu},f_{m}} \right)} = {Y{\sum\limits_{j = 1}^{k}{p^{\prime}\left( {{L_{j}❘f_{1}},\ldots\mspace{11mu},f_{m}} \right)}}}$Where

-   -   p″(L_(k)|f₁, . . . , f_(m)) represents a running sum conditional        probability    -   The labels L₁ to L_(q) for the characteristic are consistently        ordered for all documents processed.

Referring to block 3920, random number generator 3426 will generate aseries of random numbers whose values lie between 0 and 1. The number ofrandom numbers generated depend on the degree of smoothing required bythe system.

Referring to block 3930, Monte Carlo Method 3430 will generate a labelfor each random number generated as follows:G _(j) =L _(k) such that p″(L _(k) |f ₁ , . . . ,f _(m))≥r _(j) >p″(L_(k-1) |f ₁ , . . . ,f _(m))Where

-   -   G_(j) represents the generated label for random number r_(j)    -   j ranges from 1 to n where n is the number or random numbers        generated

Referring to block 3940, the n predicted characteristics are stored in apersistent memory such as a data repository.

In one embodiment, a plurality of stored prediction sets may be used todetermine an advertisement image for display on a particular displaydevice viewed by a defined group of individuals. The advertisement imageis then displayed on the particular display device. Specifically, it isoften desirable to display a first advertisement on a first displaydevice located in a first section of a venue, based on characteristicsof the people present in the first section of the venue, display asecond advertisement on a second display device located in a secondsection of a venue, based on characteristics of the people present inthe second section of the venue, etc.

In an illustrative embodiment, suppose that the management of a venuesuch as a stadium wishes to display targeted advertisements on differentdisplay devices viewed by different groups of individuals within thevenue during a live event such as a sports event. In accordance with anembodiment, systems and methods described above may be employed togenerate, for each individual seated at the venue (stadium), aprediction set containing a plurality of test values (or predictionvalues) for income level (or for as many individuals as possible orpractical). Prediction sets may be generated based on individuals' firstnames, last names, place of residence, and/or other knowncharacteristics. The prediction sets are stored.

FIG. 40 is a flowchart of a method of selecting and displaying anadvertisement image based on stored prediction sets in accordance withan embodiment. At step 4010, a group of individuals at a live event heldat a venue is defined. For example, various sections of seats in thestadium may be defined and the individuals seated in a selected sectionmay be defined as a group. In an illustrative embodiment shown in FIG.41A, multiple sections of seats in stadium 1700 are defined.Specifically, sections S-1, S-2, S-3, S-4, S-5, and S-6 are definedwithin the stadium. Each section has a plurality of seats. Accordingly,during a live event held at the stadium, a plurality of individuals areseated in each section.

Suppose now that a group referred to as Group S-1 is defined asincluding the individuals seated in Section S-1. For example, analysismodule 3390 may identify a plurality of individuals belonging to theGroup S-1 based on ticket sales or other information. Alternatively,facial recognition technology or other methods may be used.

At step 4020, a plurality of prediction sets corresponding to theindividuals in the defined group is obtained. In the illustrativeembodiment, it is supposed that prediction sets predicting income levelare generated and stored for respective individuals seated throughoutthe stadium during the live event, and therefore, analysis module 3390may retrieve a plurality of prediction sets corresponding to theindividuals in Group S-1 from storage. Alternatively, prediction setsmay be generated only for individuals seated in section S-1 usingsystems and methods described above.

At step 4030, a prediction of a demographic characteristic is determinedbased on the plurality of prediction sets. In one embodiment, analysismodule 3390 may determine an average test result value by averaging thetest results in the prediction sets associated with Group S-1, anddetermine a predicted income level corresponding the average test resultvalue based on merged probability distribution 3700, for example.Suppose, for example, that the predicted income level for theindividuals seated in section S-1 (based on the average test resultvalue) is the $50,001 to $80,000 income level.

At step 4040, an advertisement image is selected based on the predicteddemographic characteristic. For example, analysis module 3390, ordisplay manager 1660 may select an advertisement image based on thepredicted income level for Group S-1. For example, an advertisement foran automobile or beverage preferred by people having the predictedincome level may be selected.

At step 4050, the advertisement image is displayed on one or moredisplay devices associated with the defined group of individuals. Aparticular display device in the venue that is associated with thedefined group of individuals by proximity, preference, etc., may beselected. In the illustrative embodiment, at least one display device islocated in each section of stadium 1700 and is visible to most or all ofthe people in the section. Specifically, TV 1735-1 is located in sectionS-1, TV 1735-2 is located in section S-2, TV 1735-3 is located insection S-3, TV 1735-4 is located in section S-4, TV 1735-5 is locatedin section S-5, and TV 1735-6 is located in section S-6. A section mayinclude more than one display device.

In the illustrative embodiment, display manager 1660 displays theselected advertisement on TV 1735-1, which is located in section S-1 ofstadium 1700, and which is therefore proximate to and visible to most orall of the individuals in Group S-1.

In accordance with another embodiment, systems and methods describedherein may be used to generate a plurality of prediction sets for aplurality of individuals at a venue, and determine a predicteddemographic feature associated with the plurality of individuals basedon the plurality of prediction sets. An advertisement image associatedwith a tagged advertisement campaign may be selected based on thepredicted feature. One or more items of social media content associatedwith the plurality of individuals may be obtained and tagged. Forexample, items of social media content (e.g., tweets, Facebook posts,etc.) may be obtained from social network pages associated with anindividual in the group, tagged, and added to a feed. If the tagattached to a particular one of the items of social media contentmatches the tag associated with the advertisement image, then theparticular item of social media content and the advertisement image aredisplayed simultaneously on a display device associated with the groupof individuals (e.g., a display device at a location in a venueassociated with the plurality of individuals). In one embodiment, avisual instance adapted to select and display the particular item oftagged social media content and the tagged advertisement image may begenerated and used to display the particular item of social mediacontent and the advertisement image.

In other embodiments, data related to prediction sets may be stored inother forms. For example, in another embodiment, individual data objectsmay be used to organize and store data. For example, an individual datastore may be created in storage to store a plurality of individual dataobjects, where, for example, each individual data object may includedata defining an individual, second data defining a prediction set (thatincludes a plurality of test results), etc. A prediction managercomponent may be configured to generate prediction sets based on thedata relating to each individual.

FIG. 41B shows a system in accordance with another embodiment. Thesystem includes a network 4205, a prediction module 4235, an individualdata object store 4241, a prediction set store 4251, and anadvertisement module 4275.

Thus in one embodiment, individual data object store 4241 is configuredto store a plurality of individual data objects each defining featuresof a respective individual, such as individual data object 4244.Prediction set store 4251 is configured to store a plurality ofprediction sets. Prediction module 4235 is configured to identify anindividual having a plurality of first features, generate an individualdata object comprising data specifying the first features, store theindividual data object in the individual data object store, and for eachfirst feature among the plurality of first features, determine arespective probability distribution indicating, for each respectivesecond feature among a plurality of second features, a probability thata person having the respective second feature has the first feature,thereby generating a plurality of probability distributions. Predictionmodule 4235 also uses a probabilistic classifier to generate a mergedprobability distribution based on the plurality of probabilitydistributions, uses a Monte Carlo method to generate a prediction setbased on the merged probability distribution, the prediction setincluding a plurality of prediction values for the individual, eachrespective prediction value being associated with one of the pluralityof second features, and stores the prediction set in prediction setstore 4251. Advertisement module 4275 accesses the stored predictionsets and selects and displays advertisements based on the predictionsets.

While systems, apparatus and methods for predicting demographic data asdescribed herein are used in illustrative embodiments to generatepredictions of demographic data for individuals in a venue such as astadium, and to select and display advertisements to such individuals,systems, apparatus and methods for predicting demographic data asdescribed herein may be used for other purposes. For example, systems,apparatus and methods described herein may be used to predictdemographic data for individuals in a conference center, a public space,and a commercial mall, a retail store, a kiosk, etc., and to displayadvertisements to such individuals. Alternatively, systems, apparatusand methods described herein may be used to predict demographic data forindividuals who visit a web site accessible over the Internet, forindividuals who order products from a particular company, etc., and todisplay advertisements to such individuals.

In accordance with another embodiment, a plurality of prediction setsare used to generate a statistical distribution indicating theappearance of a feature within a population (or the distribution ofseveral different features within a population). Suppose, for example,that the owner of a restaurant named “Joe's Restaurant” wishes toanalyze certain demographic characteristics of the customers in therestaurant. In particular, the user wishes to compare the genderdistribution of customers who came to Joe's Restaurant on Mondays duringthe three months from January to March of the year 2015, to the genderdistribution of customers who came to Joe's Restaurant on Wednesdaysduring the same period. FIGS. 42A-42B include a flowchart of a method ofgenerating distribution information based on a plurality of predictionsets in accordance with an embodiment.

At step 4210, a first plurality of prediction sets, each prediction setbeing associated with a respective individual within a first population,each prediction set comprising a plurality of prediction results, eachprediction result corresponding to a selected one of a plurality offeatures, is stored. In the illustrative embodiment, it is supposed thatsystems and methods described herein are employed to generate aplurality of prediction sets corresponding to all customers (or as manyas possible) who visited Joe's restaurant during the months of January,February, and March of the year 2015. In order to generate theprediction sets, one or more features may be obtained based on eachcustomer's visit. For example, a customer's first name and last name maybe obtained from customer's credit cards. Additional information such ashow much money was spent, which menu items were selected, etc., may beobtained from each customer's bill. How frequently each customer visitsthe restaurant may also be determined. These and other known featuresmay be obtained and used to generate, for each customer, a predictionset containing prediction results corresponding to other selectedfeatures. In the illustrative example, a prediction set containingprediction results corresponding to gender may be generated for eachcustomer. In this manner, a plurality of prediction sets related to thegender of customers who visited Joe's Restaurant during the first threemonths of 2015 is generated; the prediction sets are stored in a memory.

At step 4220, a request for a distribution value associated with aselected feature and one or more parameters, the distribution valueindicating how often the selected feature appears in a second populationof individuals, the second population being defined by the one or moreparameters, is received from a user. The term distribution value is usedherein to mean a percentage of individuals in a population who have aselected feature. In the illustrative embodiment, the user requestsinformation indicating the gender distribution of customers who came toJoe's Restaurant on Mondays during the three months from January toMarch 2015, and information indicating the gender distribution ofcustomers who came to Joe's Restaurant on Wednesdays during the sameperiod. Thus, the user requests information indicating a firstpercentage of such customers that are MALE and a second percentage ofsuch customers who are FEMALE.

At step 4230, the first plurality of prediction sets is filtered basedon the one or more parameters, generating a second plurality ofprediction sets. The plurality of prediction sets relating to the genderof customers who visited Joe's Restaurant during the first three monthsof 2015 is filtered to define a first group (or subset) of predictionsets relating to the gender of customers who visited Joe's Restaurant onMondays during the specified time period. FIG. 43A illustrates aplurality of prediction sets 4305 in accordance with an embodiment. Sixprediction sets 4305-1, 4305-2, 4305-3, 4305-4, 4305-5, 4305-6 areshown; however, any number of prediction sets may be generated. Eachprediction set 4305 contains a plurality of prediction results. Forexample, prediction set 4305-1 includes prediction results R_(1,1),R_(1,2), R_(1,3), etc.; prediction set 4305-2 includes predictionresults R_(2,1), R_(2,2), R_(2,3), etc., and so on. Each predictionresult specifies the feature MALE or the feature FEMALE.

At step 4240, a plurality of prediction result groups are defined, eachprediction result group comprising a plurality of correspondingprediction results selected from the second plurality of predictionsets, wherein each plurality of corresponding prediction resultsincludes one prediction result selected from each of the secondplurality of prediction sets. Referring to FIG. 43B, a first predictionresult group 4360-1 including prediction results R_(1,1), R_(2,1),R_(3,1), R_(4,1), R_(5,1), and R_(6,1), is defined. A second predictionresult group 4360-2 including prediction results R_(1,2), R_(2,2),R_(3,2), R_(4,2), R_(5,2), and R_(6,2), is defined. Other predictionresult groups 4362-3, 4262-4, 4262-5, 4262-6, 4262-7, 4262-8, 4262-9,and 4262-10 are defined in a similar manner.

The prediction result groups are examined first to determine a valuerepresenting a percentage of customers who visited Joe's Restaurant onMondays during the specified time period who were MALE. A percentagevalue corresponding to MALE is determined for each of the predictionresult groups, and then the percentage values are averaged to determinean average percentage value representing the percentage of customers whovisited Joe's Restaurant on Mondays during the specified time period whowere MALE.

Thus, referring again to FIG. 42B, at step 4250, a plurality ofdistribution values associated with the selected feature is generated bydetermining, for each respective prediction result group, a respectivedistribution value for the selected feature based on the respectiveplurality of corresponding prediction results in the respectiveprediction result group. In the illustrative embodiment, the predictionresults in prediction result group 4360-1 are examined to determine howmany of the prediction results in the group correspond to the featureMALE. A first percentage value indicating how many of the predictionresults in prediction result group 4360-1 correspond to MALE isdetermined. For example, examination may show that 43% of the predictionresults in prediction result group 4360-1 correspond to the featureMALE. These steps are repeated for each prediction result group; eachprediction result group is examined to determine a percentage valueshowing how many of the prediction results in the group correspond tothe feature MALE. For example, examination may determine that 51% of theprediction results in prediction result group 4360-2 correspond to thefeature MALE, 67% of the prediction results in prediction result group4360-3 correspond to the feature MALE, etc.

At step 4260, an average distribution value is determined based on theplurality of distribution values. A first average percentage value isdetermined based on the first percentage values (corresponding to thefeature MALE). For example, an average of the percentage values mayproduce an average percentage value of 47%, indicating that 47% of thecustomers who visited Joe's Restaurant on Mondays during January,February, and March of 2015 were MALE.

In the illustrative embodiment, as each prediction result group 4360 isexamined, a second percentage value indicating how many of theprediction results in the respective prediction result group correspondto FEMALE is also determined. A second average percentage value isdetermined based on the second percentage values (corresponding to thefeature FEMALE). Thus, in the illustrative embodiment, an average of thesecond percentage values may produce a second average percentage valueof 53%, indicating that 3% of the customers who visited Joe's Restauranton Mondays during the specified time period were FEMALE.

In the illustrative embodiment, methods and apparatus described hereinare also used to determine distribution values associated with customerswho visited Joe's Restaurant on Wednesdays during January, February, andMarch of 2015. Average distribution values indicating what percentage ofsuch customers were MALE, and what percentage of such customers wereFEMALE, are determined in a manner similar to that described above.

Methods similar to those described above may also be used to determineother distribution values for the same group of customers (or for othergroups). For example, distribution values may be obtained to indicatepercentages of customers belonging to various age groups, percentages ofcustomers who are of various ethnicities, percentages of customers whohave various income levels, etc.

At step 4270, the average distribution value is provided to the user.The average percentage value(s) may be displayed on a page (e.g., a webpage) that includes a graphical representation of the averagedistribution, for example. FIG. 44 shows a web page 4400 that may bedisplayed on a display device in accordance with an embodiment. Web page4400 displays various types of information relating to customers ofJoe's Restaurant. For example, web page 4400 includes a bar 4422 thatincludes a first portion 4461 displayed in a first color or pattern, anda second portion 4462 displayed in a second color or pattern. Firstportion 4461 indicates that 47% of the customers who visited Joe'sRestaurant on Mondays during the three month period from January toMarch of 2015 were MALE. Second portion 4462 indicates that 53% of thecustomers who visited Joe's Restaurant during the same period wereFEMALE.

Page 4400 also includes information relating to a second group ofcustomers—those customers who visited Joe's Restaurant on Wednesdaysduring January, February, and March of 2015. A bar 4432 shows adistribution of the second group of customers by gender. A bar 4437shows a distribution of the second group of customers by age group.

Systems and methods described above may be also used to determinedistributions of other features, such as age, income level, ethnicity,etc. For example, similar systems and methods may be used to determinedistribution values relating to the age of customers to Joe'sRestaurant. For example, in the embodiment of FIG. 44 , page 4400 alsoincludes a bar 4427 indicating a distribution of the same group ofcustomers (i.e., customers who visited Joe's Restaurant on Mondaysduring January, February, and March of 2015) by age group. Bar 4427shows distribution values for customers who are less than 18 years ofage, for customers who are between 19 and 50 years of age, and forcustomers who are older than 50 years of age.

In accordance with another embodiment, one or more average distributionvalues relating to a plurality of individuals who are associated with aparticular display device are generated. An advertisement image isselected based on the one or more distribution values, and theadvertisement image is displayed on the particular display device. In anillustrative embodiment shown in FIG. 45A, a conference center 4500includes four conference rooms 4510, 4520, 4530, and 4540. Eachconference room has a respective plurality of seats installed therein,and a respective display device installed therein, which is visible toindividuals seated in the seats of the respective room. Accordingly,conference room 4510 has a plurality of seats 4511 and a display device4512, conference room 4520 has a plurality of seats 4521 and a displaydevice 4522, conference room 4530 has a plurality of seats 4531 and adisplay device 4532, and conference room 4540 has a plurality of seats4541 and a display device 4542.

Suppose now that a conference is held in conference center 4500, andthat a first plurality of individuals is seated in room 4510, a secondplurality of individuals is seated in room 4520, a third plurality ofindividuals is seated in room 4530, and a fourth plurality ofindividuals is seated in room 4540.

In an environment such as that shown in FIG. 45A, in which multipledisplay devices are located in a venue and each display device isvisible to a different group of individuals, it is difficult to use eachavailable display device efficiently to deliver advertising targeted tothe particular group of individuals who are currently watching theparticular display device. Advantageously, methods and apparatusdescribed herein may be employed to dynamically select, for each of theplurality of display devices in the venue, an advertisement imagetargeted at a group of individuals who are currently in proximity to therespective display device, and to display the selected advertisementimage on the respective display device.

Thus, in accordance with an embodiment, methods and apparatus describedherein are used to determine an average distribution value for aselected plurality of individuals. For example, a distribution valueindicating the gender distribution among the individuals in the firstplurality of individuals located in room 4510 may be generated. Forexample, a prediction set may be generated for each of the individualsat the conference based on information obtained through ticket sales orregistration information. Attendees may be invited to indicate prior tothe conference which speeches or presentations they plan to attend; suchinformation may be used to determine which individuals are in each roomof the conference center at any particular moment.

Suppose that methods and apparatus described herein are employed toselect an advertisement image to be displayed on display device 4512.Because display device 4512 is located in room 4510, methods and systemsdescribed herein are employed to determine distribution values for thefirst plurality of individuals (who are present in room 4510). Suppose,for example, that it is determined that 58% of the individuals in room4510 are MALE and that 42% of the individuals in room 4510 are FEMALE.An advertisement image is then selected based on the distributionvalue(s) associated with the plurality of individuals in room 4510.Accordingly, an advertisement image is selected based on the 58%MALE/42% FEMALE gender distribution values. The selected advertisementimage is then displayed on display device 4512; therefore, the selectedadvertisement image is displayed on display device 4512. For example,the advertisement image may be displayed at an appropriate time duringthe conference (e.g., during a break between speakers).

In the illustrative embodiment, distribution values may be generated forthe second plurality of individuals in room 4520, a third plurality ofindividuals in room 4530, and for a fourth plurality of individuals inroom 4540. For each room, a respective advertisement image is selectedfor the respective room based on the respective distribution values, anddisplayed on the respective display device.

FIG. 45B is a flowchart of a method of selecting and displaying anadvertisement image in accordance with an embodiment. At step 4572, aplurality of individuals associated with a particular display device isidentified. At step 4574, a plurality of prediction sets correspondingto the plurality of individuals associated with the particular displaydevice is obtained. At step 4576, a distribution value representing apercentage of the plurality of individuals who have a selected featureis determined based on the plurality of prediction sets. At step 4578,an advertisement image is selected based on the distribution value. Atstep 4580, the advertisement image is displayed on the particulardisplay device.

In accordance with another embodiment, data is provided to a user inresponse to a request. FIG. 46 is a flowchart of a method of providingdata in response to a request from a user in accordance with anembodiment. At step 4610, a user requests a report. In this step,methods may be used by which an operator of the system can request areport which includes an aggregation of a predicted characteristic. Insome embodiments, the operator may be a human operator. In someembodiments, the operator may be a request from an external system viaan API request.

At step 4620, the variable i is initialized to i=0. Loop initializationmay include methods to initialize a loop over n iterations.

At step, 4630, the label field i is aggregated based on report criteria.Data aggregation may include methods to aggregate report results for aspecific iteration from a data repository honoring any filters orconditions set by the operator when requesting the report. The followingmay be used:

${L_{k}}_{j} = \frac{\sum\limits_{i = 1}^{x}\left\{ \begin{matrix}{{1{\mspace{11mu}\;}{if}{\mspace{11mu}\;}G_{j}} = L_{k}} \\{{0\mspace{14mu}{if}\mspace{14mu} G_{j}} \neq L_{k}}\end{matrix} \right.}{x}$

Where x represents the number of documents that meet the filters orconditions set by the operator.

Data aggregation may include methods to account for circumstances wherea specific author creates more than one document.

Blocks 4630, 4640, and 4650 constitute a loop that may include methodsto repeat the report aggregation for n iterations which will generate ndifferent report results.

At step 4660, label results are averaged against all n values. This stepachieves report smoothing, which may include methods to smooth theresults from all the n iterations as follows:

${L_{k}} = \frac{\sum\limits_{j = 1}^{n}{L_{k}}_{j}}{n}$

Report smoothing may include methods to scale the results such that:

L_(k)^(′) = XL_(k) Where ${X{\sum\limits_{k = 1}^{q}{L_{k}}}} = 1$

At step 4670, results are presented to the user. Report presentation mayinclude methods to present the report results to the operator. In someembodiments, the results may be presented as data or charts on a visualdevice such as, but not limited to, a monitor, a display or mobiledevice screen. In other embodiments, the results may be presented asdata or charts over an API response.

The routine ends at step 4680.

Thus, in accordance with an embodiment, a system includes a processor, amemory communicatively coupled to the processor, and a prediction setstore communicatively coupled to the processor, configured to store aplurality of prediction set objects, each prediction set objectcomprising a prediction set that includes a plurality of test results.The system also includes a prediction management module, communicativelycoupled to the memory, configured to generate a plurality of predictionsets, each prediction set being associated with a respective individualwithin a population of individuals, each prediction set comprising arespective plurality of prediction results, each prediction resultcorresponding to a selected one of a plurality of features, store theplurality of prediction sets in the prediction set store, at a firsttime, retrieve the plurality of prediction sets from the prediction setstore, at a second time, define a plurality of prediction result groups,each prediction result group comprising a plurality of correspondingprediction results selected from the plurality of prediction sets, eachprediction result group comprising one prediction result selected fromeach of the plurality of prediction sets, generate a plurality ofdistribution values associated with a selected feature by determining,for each respective prediction result group, a respective distributionvalue for the selected feature based on the respective plurality ofcorresponding prediction results in the respective prediction resultgroup, and determine an average distribution value based on theplurality of distribution values.

In one embodiment, each respective distribution value represents apercentage of the respective prediction results in the correspondingprediction result group that correspond to the selected feature.

In another embodiment, the average distribution value represents apercentage of the individuals in the population that have the selectedfeature.

In another embodiment, the plurality of features include one of male andfemale, several discrete age ranges, several discrete income ranges, andseveral discrete ethnicities.

In another embodiment, the prediction management module is furtherconfigured to receive, from a user, a request for a distribution valueassociated with the selected feature, the distribution value indicatinghow often the selected feature appears in the population, and providethe average distribution value to the user.

In another embodiment, the prediction management module is furtherconfigured to provide to the user access to a page that includes agraphical representation of the average distribution.

In another embodiment, the prediction management module is furtherconfigured to obtain at least one of the plurality of prediction sets byperforming the following steps: determine a plurality of probabilitydistributions associated with a particular individual, use aprobabilistic classifier to generate a merged probability distributionbased on the plurality of probability distributions, and use a MonteCarlo method to generate a prediction set associated with the particularindividual based on the merged probability distribution.

In another embodiment, the prediction management module is furtherconfigured to retrieve the plurality of prediction sets from a storage.

In another embodiment, a method is provided. The method includesobtaining a plurality of prediction sets, each prediction set beingassociated with a respective individual within a population ofindividuals, each prediction set comprising a plurality of predictionresults, each prediction result corresponding to a selected one of aplurality of features, defining a plurality of prediction result groups,each prediction result group comprising a plurality of correspondingprediction results selected from the plurality of prediction sets, eachprediction result group comprising one prediction result selected fromeach of the plurality of prediction sets, generating a plurality ofdistribution values associated with a selected feature by determining,for each respective prediction result group, a respective distributionvalue for the selected feature based on the respective plurality ofcorresponding prediction results in the respective prediction resultgroup, and determining an average distribution value based on theplurality of distribution values.

In one embodiment, each respective distribution value represents apercentage of the respective prediction results in the correspondingprediction result group that correspond to the selected feature.

In another embodiment, the average distribution value represents apercentage of the individuals in the population that have the selectedfeature.

In accordance with another embodiment, a system includes a memoryadapted to store one or more prediction sets. The system also includesat least one processor adapted to obtain a plurality of prediction sets,each prediction set being associated with a respective individual withina population of individuals, each prediction set comprising a respectiveplurality of prediction results, each prediction result corresponding toa selected one of a plurality of features. The at least one processor isalso adapted to define a plurality of prediction result groups, eachprediction result group comprising a plurality of correspondingprediction results selected from the plurality of prediction sets, eachprediction result group comprising one prediction result selected fromeach of the plurality of prediction sets, generate a plurality ofdistribution values associated with a selected feature by determining,for each respective prediction result group, a respective distributionvalue for the selected feature based on the respective plurality ofcorresponding prediction results in the respective prediction resultgroup, and determine an average distribution value based on theplurality of distribution values.

Embodiments also may be directed to computer program products comprisingsoftware stored on any computer-useable medium. Such software, whenexecuted in one or more data processing device, causes a data processingdevice(s) to operate as described herein.

Embodiments of the present disclosure may employ any computer-useable orreadable medium. Examples of computer-useable mediums include, but arenot limited to, primary storage devices (e.g., any type of random accessmemory), secondary storage devices (e.g., hard drives, floppy disks, CDROMS, ZIP disks, tapes, magnetic storage devices, and optical storagedevices, MEMS, nanotechnological storage device, etc.).

Embodiments and all of the functional operations described herein may beimplemented in digital electronic circuitry, or in computer software,firmware, or hardware, including the structures disclosed in thisspecification and their structural equivalents, or in combinations ofone or more of them. Embodiments herein may be implemented as one ormore computer program products, i.e., one or more modules of computerprogram instructions encoded on a computer readable medium for executionby, or to control the operation of, data processing apparatus. Thecomputer readable medium may be a machine-readable storage device, amachine-readable storage substrate, a memory device, a composition ofmatter effecting a machine-readable propagated signal, or a combinationof one or more of them. The term “data processing apparatus” encompassesall apparatus, devices, and machines for processing data, including byway of example a programmable processor, a computer, or multipleprocessors or computers. The apparatus may include, in addition tohardware, code that creates an execution environment for the computerprogram in question, e.g., code that constitutes processor firmware, aprotocol stack, a database management system, an operating system, or acombination of one or more of them. A propagated signal is anartificially generated signal, e.g., a machine-generated electrical,optical, or electromagnetic signal that is generated to encodeinformation for transmission to suitable receiver apparatus.

A computer program (also known as a program, software, softwareapplication, script, or code) may be written in any form of programminglanguage, including compiled or interpreted languages, and it may bedeployed in any form, including as a stand-alone program or as a module,component, subroutine, or other unit suitable for use in a computingenvironment. A computer program does not necessarily correspond to afile in a file system. A program may be stored in a portion of a filethat holds other programs or data (e.g., one or more scripts stored in amarkup language document), in a single file dedicated to the program inquestion, or in multiple coordinated files (e.g., files that store oneor more modules, sub programs, or portions of code). A computer programmay be deployed to be executed on one computer or on multiple computersthat are located at one site or distributed across multiple sites andinterconnected by a communication network.

The processes and logic flows described in this specification may beperformed by one or more programmable processors executing one or morecomputer programs to perform functions by operating on input data andgenerating output. The processes and logic flows may also be performedby, and apparatus may also be implemented as, special purpose logiccircuitry, e.g., an FPGA (field programmable gate array) or an ASIC(application specific integrated circuit).

The foregoing description of the specific embodiments will so fullyreveal the general nature of the invention that others can, by applyingknowledge within the skill of the art, readily modify and/or adapt forvarious applications such specific embodiments, without undueexperimentation, without departing from the general concept of thepresent invention. Therefore, such adaptations and modifications areintended to be within the meaning and range of equivalents of thedisclosed embodiments, based on the teaching and guidance presentedherein.

The breadth and scope of the present invention should not be limited byany of the above-described exemplary embodiments or any actual softwarecode with the specialized control of hardware to implement suchembodiments, but should be defined only in accordance with the followingclaims and their equivalents.

The invention claimed is:
 1. A server comprising: a processor; a memorydevice communicatively coupled to the processor; and wherein theprocessor is configured to obtain a first plurality of prediction setsby determining a plurality of probability distributions associated witha characteristic of an individual and use a probabilistic classifier togenerate a merged probability distribution based on the plurality ofprobability distributions; a database communicatively coupled to theprocessor, configured to store the first plurality of prediction sets,each prediction set being associated with a respective characteristic ofan individual within a first population, each prediction set comprisinga plurality of prediction results, each prediction result correspondingto a selected one of a plurality of features associated with thecharacteristic; and wherein the processor is configured to generate aplurality of distribution values associated with the selected onefeature by determining, for each respective prediction result, arespective distribution value for the selected one feature based on therespective plurality of corresponding prediction results in a respectiveprediction result group; determine an average distribution value basedon the plurality of distribution values, the average distribution valueindicating how often the selected feature appears as a characteristic ina second population of individuals; select an advertisement image basedon the average distribution value; and display the advertisement imageon a first display in a particular location among a plurality ofdisplays in various locations, wherein the first display is selected forthe advertisement image based on a percentage distribution of aprediction result associated with the selected one of the plurality offeatures, among the plurality of prediction results, predicted to bepresent among the characteristics of the individuals in the particularlocation.
 2. The server of claim 1, wherein the processor is furtherconfigured to filter the first plurality of prediction sets based on theone or more parameters, generating a second plurality of predictionsets.
 3. The server of claim 2, wherein the processor is furtherconfigured to define a plurality of prediction result groups, eachprediction result group comprising a plurality of correspondingprediction results selected from the second plurality of predictionsets, wherein each plurality of corresponding prediction resultsincludes one prediction result selected from each of the secondplurality of prediction sets.
 4. The server of claim 1, wherein theprocessor is further configured to provide the average distributionvalue to a display device, wherein the display device is configured todisplay the distribution value using an interactive graphical userinterface (GUI).
 5. A method comprising: obtaining, a first plurality ofprediction sets by determining a plurality of probability distributionsassociated with a characteristic of an individual and use aprobabilistic classifier to generate a merged probability distributionbased on the plurality of probability distributions; storing the firstplurality of prediction sets, each prediction set being associated witha respective characteristic of an individual within a first population,each prediction set comprising a plurality of prediction results, eachprediction result corresponding to a selected one of a plurality offeatures associated with the characteristic; generating a plurality ofdistribution values associated with the selected one feature bydetermining, for each respective prediction result, a respectivedistribution value for the selected one feature based on the respectiveplurality of corresponding prediction results in a respective predictionresult group; determining an average distribution value based on theplurality of distribution values, the average distribution valueindicating how often the selected feature appears as a characteristic ina second population of individuals; selecting; an advertisement imagebased on the average distribution value; and displaying theadvertisement image on a first display in a particular location among aplurality of displays in various locations, wherein the first display isselected for the advertisement image based on a percentage distributionof a prediction result associated with the selected one of the pluralityof features, among the plurality of prediction results, predicted to bepresent among the characteristics of the individuals in the particularlocation.
 6. The method of claim 5, further comprising: filtering thefirst plurality of prediction sets based on the one or more parameters,generating a second plurality of prediction sets.
 7. The method of claim6, further comprising: defining a plurality of prediction result groups,each prediction result group comprising a plurality of correspondingprediction results selected from the second plurality of predictionsets.
 8. The method of claim 7, wherein each plurality of correspondingprediction results includes one prediction result selected from each ofthe second plurality of prediction sets.
 9. The method of claim 5,wherein the display device is configured to display the distributionvalue using an interactive graphical user interface (GUI).